-- Logs begin at Fri 2021-12-17 11:57:01 UTC, end at Fri 2021-12-17 13:32:24 UTC. -- Dec 17 12:28:32.471191 dv-cinder-801522-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 17 12:28:32.479982 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 17 12:28:32 2021] *** Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: nodename: dv-cinder-801522-9-iscsi Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: machine: x86_64 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: clock source: unix Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: pcre jit disabled Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: detected number of CPU cores: 4 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: current working directory: / Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: detected binary path: /usr/bin/uwsgi-core Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: your processes number limit is 47680 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: your memory page size is 4096 bytes Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: detected max file descriptor number: 2048 Dec 17 12:28:32.481979 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: lock engine: pthread robust mutexes Dec 17 12:28:32.482981 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: thunder lock: enabled Dec 17 12:28:32.482981 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 17 12:28:32.482981 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 17 12:28:32.525415 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: Python main interpreter initialized at 0x55560da5e9c0 Dec 17 12:28:32.525415 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: python threads support enabled Dec 17 12:28:32.525415 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: your server socket listen backlog is limited to 100 connections Dec 17 12:28:32.525415 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: your mercy for graceful operations on workers is 90 seconds Dec 17 12:28:32.525758 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: mapped 403077 bytes (393 KB) for 2 cores Dec 17 12:28:32.525843 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: *** Operational MODE: preforking *** Dec 17 12:28:32.526076 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: *** uWSGI is running in multiple interpreter mode *** Dec 17 12:28:32.526076 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: spawned uWSGI master process (pid: 101867) Dec 17 12:28:32.526266 dv-cinder-801522-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 17 12:28:32.527066 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: spawned uWSGI worker 1 (pid: 101868, cores: 1) Dec 17 12:28:32.527066 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: spawned uWSGI worker 2 (pid: 101869, cores: 1) Dec 17 12:28:32.527235 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 17 12:28:34.213065 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:28:34.213065 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: from cryptography.utils import int_from_bytes Dec 17 12:28:34.213740 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:28:34.213740 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: from cryptography.utils import int_from_bytes Dec 17 12:28:34.215206 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:28:34.215206 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: from cryptography.utils import int_from_bytes Dec 17 12:28:34.215711 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:28:34.215711 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: from cryptography.utils import int_from_bytes Dec 17 12:28:36.735757 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 17 12:28:36.736360 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 17 12:28:36.736710 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 17 12:28:36.736800 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 17 12:28:36.736868 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 17 12:28:36.736939 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 17 12:28:36.737005 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 17 12:28:36.737070 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 17 12:28:36.737131 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 17 12:28:36.737193 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 17 12:28:36.737483 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.737593 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.737785 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.737915 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738082 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738177 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738420 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738548 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738763 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.738893 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739069 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739229 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739366 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739457 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739680 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.739776 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740006 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740115 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740258 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740345 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740581 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740688 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740901 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-9-iscsi {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.740990 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-9-iscsi {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741217 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741340 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741545 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741633 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741858 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.741953 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742173 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742268 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742478 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742573 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742781 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.742877 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.743084 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.743167 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.743581 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.743706 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744014 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744106 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744319 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744412 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744631 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744723 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.744964 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745054 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745307 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745449 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745609 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745716 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.745927 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746040 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746240 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746363 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746560 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746671 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746866 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.746965 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.747271 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-9-iscsi {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.747374 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-9-iscsi {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.747589 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.747693 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.747899 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748033 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748208 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748295 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748674 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748804 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.748987 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749180 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749312 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749399 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749634 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749769 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.749958 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750043 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750266 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750358 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750593 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750683 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750911 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.750995 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751229 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751326 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751545 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751671 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751846 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.751929 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752151 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752244 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752459 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752554 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752777 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.752863 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753080 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753175 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753405 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753511 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753655 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753738 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.753963 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754051 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754280 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754370 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754600 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754685 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.754922 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755011 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755174 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755267 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755421 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755518 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755741 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.755833 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756059 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756159 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756368 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756471 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756674 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756760 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.756980 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757314 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757427 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757619 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757714 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.757924 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758033 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758229 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758321 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758532 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758622 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758848 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.758939 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759163 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759255 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759484 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759574 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759790 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.759888 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760199 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760503 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760602 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760754 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.760852 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761061 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761153 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761417 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761509 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761741 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.761849 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762049 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762148 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762365 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762455 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762683 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762782 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.762990 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763082 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763294 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763385 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763596 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763687 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.763936 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764039 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764271 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764363 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764577 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764669 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764827 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.764925 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765125 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765216 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765453 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765544 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765771 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.765860 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766078 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766167 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766383 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766473 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766690 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766786 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.766988 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767081 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767290 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767379 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767598 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767729 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.767901 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768034 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768206 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768333 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768511 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768643 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768811 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.768953 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769117 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769242 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769444 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769574 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769748 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.769891 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770064 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770190 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770383 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770509 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770689 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770845 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.770974 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771281 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771411 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771587 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771725 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.771943 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772085 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772216 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772345 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772496 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772630 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772814 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.772945 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773119 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773251 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773447 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773609 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773753 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.773888 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774061 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774198 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774366 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774583 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774718 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774865 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.774997 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775127 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775267 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775400 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775558 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775703 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.775864 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776002 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776169 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776306 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776470 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776619 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776832 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.776973 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777115 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777249 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777408 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777551 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777684 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777815 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.777963 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778103 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778237 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778375 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778528 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778669 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778836 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.778974 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779142 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779286 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779448 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779624 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779802 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.779941 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.780120 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.780259 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:28:36.780462 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.780618 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.780820 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.780962 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781162 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781316 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781502 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781658 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781841 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.781985 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782136 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782223 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782473 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782605 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782782 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.782926 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783099 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783231 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783419 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783550 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783727 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.783869 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784037 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784168 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784345 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784488 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784660 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784792 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.784978 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785124 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785301 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785423 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785643 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785773 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.785960 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786100 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786281 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786415 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786575 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786718 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786871 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.786968 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787198 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787292 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787520 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787603 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787831 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.787938 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788167 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788252 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788508 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788601 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788821 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.788913 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789144 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789229 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789482 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789569 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789805 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.789903 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790119 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790207 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790432 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790647 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790735 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.790823 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791062 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791161 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791374 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791457 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791690 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.791776 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792023 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792115 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792340 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792424 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792656 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792742 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.792960 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793043 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793267 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793412 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793594 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793680 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793903 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.793985 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794207 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794299 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794526 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794611 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794851 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.794936 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795179 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795274 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795513 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795598 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795821 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.795906 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796133 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796227 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796445 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796535 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796749 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.796833 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797062 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797230 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797399 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797485 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797704 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.797793 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798029 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798131 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798339 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798431 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798644 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798735 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.798966 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799052 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799274 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799386 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799578 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799667 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799892 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.799981 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800202 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800302 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800510 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800605 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800819 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.800914 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801141 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801236 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801479 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801619 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801789 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.801928 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802118 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802333 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802472 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802618 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802763 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.802901 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803041 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803183 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803363 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803511 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803677 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803815 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.803979 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804117 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804287 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804440 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804575 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804717 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.804881 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805027 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805168 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805334 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805503 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805642 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805807 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.805946 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806108 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806248 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806408 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806552 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806699 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.806857 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807002 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807136 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807310 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807449 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807617 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807763 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.807907 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808063 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808217 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808365 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808522 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808671 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.808862 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809000 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809166 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809326 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809531 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809682 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.809869 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810006 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810190 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810403 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810551 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810702 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.810899 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811046 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811193 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811327 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811488 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811635 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811807 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.811944 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812118 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812262 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812475 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812624 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812770 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.812902 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813064 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813205 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813375 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813511 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813677 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813822 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.813997 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814133 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814307 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814447 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814624 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814772 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.814914 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815046 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815230 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815370 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815567 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815706 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.815898 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816035 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816215 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816354 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816533 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816678 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816844 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.816981 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817154 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817320 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817470 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817603 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817784 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.817936 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818079 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818212 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818384 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818522 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818703 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818859 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.818995 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819127 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819309 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819447 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819618 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819765 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.819938 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820077 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820244 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820397 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820597 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820744 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.820895 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.821400 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.821534 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.821665 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.821838 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.821979 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822167 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822308 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822463 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822670 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822817 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.822950 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823101 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823242 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823375 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823514 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823659 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823799 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.823961 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.824103 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.824775 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.824926 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825061 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825194 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825403 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825541 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825673 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825817 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.825951 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826091 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826224 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826415 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826672 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826810 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.826942 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827073 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827205 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827356 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827499 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827632 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827764 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.827895 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828034 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828167 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828309 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828443 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828574 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828712 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828844 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.828976 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829130 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829264 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829431 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829565 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829696 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829837 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.829976 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830239 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830371 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830502 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830728 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.830869 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831013 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831152 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831293 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831427 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831567 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831700 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831838 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.831971 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832101 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832233 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832373 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832506 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832653 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.832868 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833009 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833149 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833324 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833464 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833598 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833731 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.833862 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834006 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834141 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834309 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834448 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834620 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834760 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.834932 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835074 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835243 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835396 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835541 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835676 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835852 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.835994 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836174 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836319 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836484 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836642 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836798 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.836937 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837109 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837247 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837437 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837587 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837750 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.837900 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.838069 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.838207 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.838649 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.838798 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.838979 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839125 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839294 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839432 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839614 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839764 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.839933 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840074 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840252 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840390 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840582 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840745 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.840963 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841247 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841431 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841583 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841723 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.841869 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842039 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842192 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842340 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842488 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842628 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842766 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.842996 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843150 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843290 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843440 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843581 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843727 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.843870 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844009 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844155 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844295 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844433 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844570 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844716 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.844866 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845018 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845167 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845335 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845493 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845646 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845788 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.845935 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846084 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846223 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846374 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846515 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846659 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846810 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.846948 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847094 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847242 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847388 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847528 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847665 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847803 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.847953 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848093 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848241 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848381 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848530 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848705 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.848866 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849035 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849188 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849386 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849542 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849683 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.849901 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850050 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850190 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850329 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850466 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850625 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850773 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.850913 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851131 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851276 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851416 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851563 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851711 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.851858 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852000 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852139 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852277 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852425 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852575 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852714 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.852852 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853011 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853249 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853431 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853574 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853713 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853852 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.853997 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854149 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854296 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854435 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854595 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854744 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.854883 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855029 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855169 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855308 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855448 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855588 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855734 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.855998 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856158 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856300 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856449 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856589 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856727 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.856875 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857015 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857162 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857323 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857469 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857641 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.857858 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858002 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858141 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858279 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858429 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858578 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858720 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858858 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.858998 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859136 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859281 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859430 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859570 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859715 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859855 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.859993 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860131 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860289 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860429 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860567 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860730 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.860873 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861026 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861245 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861426 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861566 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861704 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861844 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.861996 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862137 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862287 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862426 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862563 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862729 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.862887 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863028 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863167 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863384 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863528 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863668 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863819 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.863961 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864100 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864257 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864396 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864543 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864707 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864848 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.864994 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865140 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865300 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865458 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865600 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865754 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.865936 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866101 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866242 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866389 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866545 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866708 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866857 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.866998 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867139 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867285 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867425 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867564 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867702 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.867839 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868000 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868142 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868286 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868426 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868590 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868732 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.868880 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869020 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869171 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869357 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869503 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869642 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869642 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.869930 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870078 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870218 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870356 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870525 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870678 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870820 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.870958 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871095 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871250 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871461 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871620 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871760 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.871911 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872050 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872190 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872336 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872486 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872625 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872770 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.872909 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873045 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873191 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873398 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873614 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873768 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.873918 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874066 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874214 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874360 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874507 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874647 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874793 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.874932 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875084 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875225 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875363 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875502 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875652 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875806 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.875963 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876104 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876242 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876381 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876520 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876667 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876809 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.876954 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877092 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877230 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877426 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877658 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877809 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.877949 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878089 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878235 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878374 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878522 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878674 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878785 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878868 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.878964 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879057 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879145 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879224 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879352 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879503 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879734 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.879888 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880078 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880221 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880391 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880592 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880737 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.880886 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881027 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881176 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881341 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881561 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881708 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.881861 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882002 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882140 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882277 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882416 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882592 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882737 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.882912 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883057 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883245 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883391 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883544 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883769 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.883916 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884055 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884193 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884331 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884479 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884619 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884757 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.884896 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885042 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885192 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885398 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885548 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885688 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885826 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.885965 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886112 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886252 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886425 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886568 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886706 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.886910 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887065 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887218 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887357 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887504 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887651 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.887912 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888069 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888211 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888350 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888515 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888656 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.888831 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889033 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889188 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889355 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889550 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889695 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889850 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.889999 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890147 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890286 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890456 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890601 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890780 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.890926 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891104 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891261 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891400 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891553 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891771 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.891916 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892055 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892201 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892349 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892489 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892636 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892775 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.892923 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893061 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893232 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893475 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893620 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893774 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.893981 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894130 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894293 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894443 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894584 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894731 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.894910 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895050 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895200 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895339 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895478 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895625 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895765 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.895903 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896041 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896179 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896340 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896494 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896644 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896783 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.896951 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897108 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897256 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897429 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897592 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897736 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.897900 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898045 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898195 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898336 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898474 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898613 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898788 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.898931 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899094 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899241 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899389 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899528 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899675 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899815 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.899998 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900152 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900318 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900472 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900629 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900770 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.900918 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901069 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901209 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901394 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901536 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901689 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.901906 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902060 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902201 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902340 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902485 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902638 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902781 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.902918 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903076 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903228 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903368 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903514 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903660 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903801 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.903947 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904167 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904320 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904461 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904634 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904775 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.904933 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905073 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905221 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905434 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905538 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905657 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.905874 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906018 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906152 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906257 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906492 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906636 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906764 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.906868 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907103 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907234 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907401 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907531 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907705 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907849 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.907977 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908072 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908300 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908432 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908603 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908753 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908879 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.908982 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909207 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909360 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909540 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909712 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909799 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.909875 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910133 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910278 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910410 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910518 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910735 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.910879 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911023 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911122 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911331 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911473 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911639 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911765 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.911994 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912104 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912308 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912408 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912633 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912722 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.912935 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913023 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913261 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913384 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913609 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913706 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.913918 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914007 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914233 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914324 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914547 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914637 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914860 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.914958 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915175 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915264 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915470 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915553 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915779 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.915914 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916089 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916173 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916400 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916486 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916716 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.916809 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917038 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917229 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917582 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917668 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917897 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.917997 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918207 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918301 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918519 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918604 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918832 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.918919 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919144 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919228 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919455 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919540 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919766 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.919851 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920072 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920188 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920431 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920519 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920743 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.920829 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921064 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921147 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921414 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921582 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921743 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.921873 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922059 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922159 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922373 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922469 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922688 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.922775 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923002 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923095 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923318 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923447 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923661 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923748 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.923966 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924051 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924279 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924366 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924591 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924683 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924902 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.924987 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.925214 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.925328 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.925906 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926008 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926008 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926163 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926243 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926320 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926465 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926577 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926775 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.926871 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927086 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927178 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927396 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927482 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927714 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.927816 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928042 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928128 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928357 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928440 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928670 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928756 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.928983 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.929069 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.929313 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.929416 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.929633 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.929833 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930147 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930231 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930467 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930551 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930789 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.930875 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931113 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931199 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931438 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931583 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931751 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.931838 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932067 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932152 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932369 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932466 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932673 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932758 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.932983 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933076 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933318 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933447 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933624 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933726 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.933927 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934019 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934239 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934446 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934544 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934622 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934847 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.934940 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.935151 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.935257 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.935468 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.935685 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936034 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936128 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936367 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936502 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936685 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.936812 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937009 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937140 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937349 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937490 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937660 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937786 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.937967 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938096 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938279 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938406 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938584 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938718 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.938889 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939035 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939197 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939323 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939502 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939628 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939805 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.939940 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940092 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940216 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940407 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940542 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940709 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.940844 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941002 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941131 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941326 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941419 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941639 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941767 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.941965 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942058 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942269 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942405 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942570 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942657 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942876 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.942969 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943179 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943264 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943482 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943575 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943783 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.943874 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944086 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944171 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944440 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944565 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944689 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944775 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.944990 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.945081 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.945319 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.945409 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.945616 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.945701 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946256 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946360 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946568 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946663 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946870 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.946955 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947171 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947265 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947482 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947567 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947785 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.947872 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948088 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948181 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948395 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948485 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948706 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.948792 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949018 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949112 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949349 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949437 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949665 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949758 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.949996 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.950090 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.950318 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.950527 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.950855 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.950951 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.951223 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.951310 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.951606 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.951695 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.951953 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952043 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952262 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952350 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952566 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952654 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952867 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.952952 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953190 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953305 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953525 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953622 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953834 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.953930 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954147 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954239 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954453 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954537 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954762 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.954872 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955071 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955163 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955380 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955464 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955686 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.955779 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956035 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956127 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956305 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956390 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956621 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956707 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.956950 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957034 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957270 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957382 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957608 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957696 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.957925 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958010 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958234 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958331 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958545 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958632 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958854 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.958947 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959160 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959246 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959471 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959566 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959791 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.959876 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960102 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960194 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960410 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960508 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960719 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.960824 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961135 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961229 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961476 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961575 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961793 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.961917 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962101 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962197 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962416 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962502 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962733 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.962819 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963041 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963127 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963353 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963444 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963658 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963743 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.963976 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964074 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964308 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964393 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964635 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964715 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.964957 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965043 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965261 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965395 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965614 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965716 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965874 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.965960 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966181 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966275 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966489 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966582 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966820 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.966907 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967155 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967241 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967474 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967575 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967786 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.967885 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968097 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968182 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968402 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968488 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968717 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.968801 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969033 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969120 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969387 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969478 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969698 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.969785 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970010 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970096 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970320 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970421 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970631 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970729 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.970937 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971024 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971243 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971340 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971552 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971638 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.971855 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972000 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972170 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972255 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972491 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972576 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972796 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.972895 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973106 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973200 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973443 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973530 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973763 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.973859 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974077 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974162 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974385 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974484 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974696 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.974794 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975006 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975095 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975319 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975405 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975627 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975714 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.975937 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976021 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976247 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976332 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976556 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976642 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976870 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.976962 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977193 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977322 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977544 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977633 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977868 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.977953 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978199 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978300 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978507 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978603 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978847 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.978932 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979174 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979273 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979528 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979637 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979799 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.979893 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.980103 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.980198 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.980346 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 17 12:28:36.980432 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:28:36.980634 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 17 12:28:37.003447 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_db.sqlalchemy.engines [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.005062 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_db.sqlalchemy.engines [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.067908 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.context [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70d6da78-ff38-4fe6-9546-7442c31f6ddc(cell1) {{(pid=101868) load_cells /opt/stack/nova/nova/context.py:464}} Dec 17 12:28:37.068353 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.context [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70d6da78-ff38-4fe6-9546-7442c31f6ddc(cell1) {{(pid=101869) load_cells /opt/stack/nova/nova/context.py:464}} Dec 17 12:28:37.072766 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_concurrency.lockutils [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:28:37.072904 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:28:37.074421 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_concurrency.lockutils [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:28:37.074552 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:28:37.075257 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_concurrency.lockutils [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:28:37.075394 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:28:37.077233 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_concurrency.lockutils [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:28:37.077413 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:28:37.088797 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_db.sqlalchemy.engines [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.090062 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_db.sqlalchemy.engines [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.092694 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_db.sqlalchemy.engines [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.095637 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_db.sqlalchemy.engines [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.256759 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_db.sqlalchemy.engines [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.260347 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG oslo_db.sqlalchemy.engines [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:28:37.595787 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: WARNING keystonemiddleware.auth_token [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:28:37.599829 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: WARNING keystonemiddleware.auth_token [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:28:37.604312 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: WARNING keystonemiddleware.auth_token [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:28:37.606565 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: WARNING keystonemiddleware.auth_token [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:28:37.947344 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: WARNING keystonemiddleware.auth_token [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:28:37.951728 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: WARNING keystonemiddleware.auth_token [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:28:37.952721 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: WARNING keystonemiddleware.auth_token [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:28:37.957057 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: WARNING keystonemiddleware.auth_token [None req-bf6a1fd0-565f-4c3b-80a6-ff4c1f14a1fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:28:37.957884 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55560da5e9c0 pid: 101868 (default app) Dec 17 12:28:37.964895 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:28:37.964895 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Dec 17 12:28:37.964895 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Fri Dec 17 12:28:37 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:28:37.965180 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55560da5e9c0 pid: 101869 (default app) Dec 17 12:29:59.632569 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:29:59.634270 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Dec 17 12:29:59.634971 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:29:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:00.074672 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-6f6c21d3-1398-464e-af4d-3b0418fe5dea admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:00.104707 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-6f6c21d3-1398-464e-af4d-3b0418fe5dea admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461653 Dec 17 12:30:00.105635 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Dec 17 12:29:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:02.486212 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:02.487372 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-6232efcb-302b-4f7a-b2ec-2b9d22d4a1af None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 17 12:30:02.488244 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:02.550916 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-5cfa45e5-439b-4f93-9b08-2d1d0726dac3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:02.575636 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:30:02.575636 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:30:02.605512 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-5cfa45e5-439b-4f93-9b08-2d1d0726dac3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111015 Dec 17 12:30:02.606393 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 12:30:02.850272 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-1aada680-ffeb-441c-bcd2-b9ff1703176f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:02.853459 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:30:02.853459 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: warnings.warn(msg) Dec 17 12:30:02.906022 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-1aada680-ffeb-441c-bcd2-b9ff1703176f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291440 Dec 17 12:30:02.909325 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Dec 17 12:30:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:05.279099 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-5cfa45e5-439b-4f93-9b08-2d1d0726dac3 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:05.280193 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-5cfa45e5-439b-4f93-9b08-2d1d0726dac3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 17 12:30:05.280897 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:05.404868 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-5c6850f2-e2b7-4445-9718-9d4a2c6696e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:05.422545 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:30:05.422545 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: warnings.warn(msg) Dec 17 12:30:05.446099 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-5c6850f2-e2b7-4445-9718-9d4a2c6696e7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158489 Dec 17 12:30:05.454173 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:05.462174 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-8bfd80ed-60db-404e-8481-60131892c2d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:05.463586 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:30:05.463586 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:30:05.497208 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-8bfd80ed-60db-404e-8481-60131892c2d0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041447 Dec 17 12:30:05.498047 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Dec 17 12:30:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:07.886971 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-5c6850f2-e2b7-4445-9718-9d4a2c6696e7 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:07.888327 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-5c6850f2-e2b7-4445-9718-9d4a2c6696e7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Dec 17 12:30:07.888995 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:07.951363 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-a8fdd83a-a143-4d64-b127-53cb86392a84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:07.975202 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-a8fdd83a-a143-4d64-b127-53cb86392a84 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079645 Dec 17 12:30:07.975856 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:07.988083 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-30923f1b-29f4-4c33-bdd3-abae9a7307bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:08.011438 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-30923f1b-29f4-4c33-bdd3-abae9a7307bc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027084 Dec 17 12:30:08.012282 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Dec 17 12:30:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:10.410414 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-a8fdd83a-a143-4d64-b127-53cb86392a84 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:10.411423 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-a8fdd83a-a143-4d64-b127-53cb86392a84 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Dec 17 12:30:10.411818 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:10.470730 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-c2414786-972e-4d83-b1c2-8b18a2a040fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:10.490661 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-c2414786-972e-4d83-b1c2-8b18a2a040fa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072555 Dec 17 12:30:10.491303 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:10.503477 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-0e456530-2494-45b5-a6de-ce722f4bf19a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:10.527385 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-0e456530-2494-45b5-a6de-ce722f4bf19a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027527 Dec 17 12:30:10.528260 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Dec 17 12:30:10 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:30:12.932647 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-c2414786-972e-4d83-b1c2-8b18a2a040fa admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:12.933692 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-c2414786-972e-4d83-b1c2-8b18a2a040fa admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Dec 17 12:30:12.934109 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:12.997152 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "ram": 4096, "disk": 20}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:13.017731 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076954 Dec 17 12:30:13.018403 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:13.031021 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-56066587-5851-4892-a45a-cc5e84a8be58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:13.056709 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-56066587-5851-4892-a45a-cc5e84a8be58 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029686 Dec 17 12:30:13.057765 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Dec 17 12:30:13 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:15.490009 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:15.491098 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Dec 17 12:30:15.491509 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:15.557668 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-c4150c4e-215e-4bf8-8f15-917ea14512e2 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:15.581300 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-c4150c4e-215e-4bf8-8f15-917ea14512e2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082678 Dec 17 12:30:15.581847 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Dec 17 12:30:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:30:17.976692 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:17.977763 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-7df21799-4b1f-46e5-8c04-dd86b9038590 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Dec 17 12:30:17.978171 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:18.044720 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-69f70244-24aa-477b-a39c-0abfebd92a63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:18.064467 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-69f70244-24aa-477b-a39c-0abfebd92a63 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079637 Dec 17 12:30:18.065065 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:17 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:18.078426 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-e5a2afd1-2927-4ad3-b631-50263a23568d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:18.100995 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-e5a2afd1-2927-4ad3-b631-50263a23568d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026403 Dec 17 12:30:18.101634 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Dec 17 12:30:18 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:20.841606 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-69f70244-24aa-477b-a39c-0abfebd92a63 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:20.843615 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-69f70244-24aa-477b-a39c-0abfebd92a63 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Dec 17 12:30:20.843738 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:20.906715 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-d8cf5646-79a2-45d3-9167-eb7597716552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:20.926869 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-d8cf5646-79a2-45d3-9167-eb7597716552 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076631 Dec 17 12:30:20.927579 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:20.939939 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-2ae208f3-965b-4bce-8f98-aab6e43f2502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:20.963936 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-2ae208f3-965b-4bce-8f98-aab6e43f2502 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027821 Dec 17 12:30:20.964544 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Dec 17 12:30:20 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:23.306316 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-d8cf5646-79a2-45d3-9167-eb7597716552 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:23.307318 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-d8cf5646-79a2-45d3-9167-eb7597716552 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 17 12:30:23.307732 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:23.365563 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-15fa22ab-fe8e-4671-92b8-ee08fab1b067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "id": "3", "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:23.383772 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-15fa22ab-fe8e-4671-92b8-ee08fab1b067 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069764 Dec 17 12:30:23.384318 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:23 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 12:30:23.396337 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-113c2667-85f7-4133-9250-ebcbadebc1d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:23.420800 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-113c2667-85f7-4133-9250-ebcbadebc1d5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028013 Dec 17 12:30:23.421553 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Dec 17 12:30:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:25.829170 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-15fa22ab-fe8e-4671-92b8-ee08fab1b067 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:25.831097 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-15fa22ab-fe8e-4671-92b8-ee08fab1b067 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Dec 17 12:30:25.832406 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:25 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:25.892093 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-e4525fff-a9e9-4b5b-a54c-baf4114d570f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "id": "4", "vcpus": 4}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:25.913403 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-e4525fff-a9e9-4b5b-a54c-baf4114d570f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074488 Dec 17 12:30:25.913953 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:25.930823 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-2778171c-59c9-421f-96a1-c5ea57c52eb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:25.955999 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-2778171c-59c9-421f-96a1-c5ea57c52eb3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033115 Dec 17 12:30:25.956582 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Dec 17 12:30:25 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:30:28.351037 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-e4525fff-a9e9-4b5b-a54c-baf4114d570f admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:28.352062 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-e4525fff-a9e9-4b5b-a54c-baf4114d570f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Dec 17 12:30:28.353612 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:28.413718 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "name": "m1.xlarge", "swap": 0}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:28.436339 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076828 Dec 17 12:30:28.437341 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Dec 17 12:30:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:28.456773 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-2e5dfcf7-a28f-429d-8b95-4377fe0802a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:28.483751 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-2e5dfcf7-a28f-429d-8b95-4377fe0802a2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038158 Dec 17 12:30:28.485386 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Dec 17 12:30:28 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:30:49.960689 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:49.961751 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 17 12:30:49.962148 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:30:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:50.024955 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-736883c2-b12e-4de3-8ad0-18a84be382f1 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:50.042506 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-736883c2-b12e-4de3-8ad0-18a84be382f1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073622 Dec 17 12:30:50.043039 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Dec 17 12:30:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:51.646023 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:51.647066 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-760637b2-a8a0-47da-a648-f8da8978a31b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Dec 17 12:30:51.647487 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:30:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:51.840550 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-c3a3f6a7-76f3-4fd8-9e25-174a531c5a34 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:51.846330 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.wsgi [None req-c3a3f6a7-76f3-4fd8-9e25-174a531c5a34 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 17 12:30:51.846820 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-c3a3f6a7-76f3-4fd8-9e25-174a531c5a34 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:51.847614 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-c3a3f6a7-76f3-4fd8-9e25-174a531c5a34 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062630 Dec 17 12:30:51.848127 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Dec 17 12:30:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 17 12:30:51.858132 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-78066fab-986c-4c69-95f4-842ececdf132 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:51.885114 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-78066fab-986c-4c69-95f4-842ececdf132 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030287 Dec 17 12:30:51.885858 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:51.898509 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-0774ff10-e364-4240-bc10-093f8c054a24 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:51.927013 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-0774ff10-e364-4240-bc10-093f8c054a24 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034198 Dec 17 12:30:51.927564 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:51.937421 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-850b032c-fb09-47d8-88f4-a98a37af01ee admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:51.943128 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.wsgi [None req-850b032c-fb09-47d8-88f4-a98a37af01ee admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 17 12:30:51.943693 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-850b032c-fb09-47d8-88f4-a98a37af01ee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:51.944473 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-850b032c-fb09-47d8-88f4-a98a37af01ee admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010599 Dec 17 12:30:51.944957 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Dec 17 12:30:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 17 12:30:53.440432 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-0774ff10-e364-4240-bc10-093f8c054a24 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:53.442002 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-0774ff10-e364-4240-bc10-093f8c054a24 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Dec 17 12:30:53.442567 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:30:53 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:53.648142 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-442f6fe7-8fb4-478d-a714-0a96e41980b3 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:53.654287 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.wsgi [None req-442f6fe7-8fb4-478d-a714-0a96e41980b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 17 12:30:53.654860 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-442f6fe7-8fb4-478d-a714-0a96e41980b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:53.655669 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-442f6fe7-8fb4-478d-a714-0a96e41980b3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069808 Dec 17 12:30:53.656367 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Dec 17 12:30:53 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 17 12:30:53.667923 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-8b6109e5-3f6b-4a0d-ab97-479fd696f24c admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:53.682782 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-8b6109e5-3f6b-4a0d-ab97-479fd696f24c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020137 Dec 17 12:30:53.683276 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:53.693318 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-dce71ba7-bd4a-4d4b-b9ea-bcff3d0a2320 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:53.707548 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-dce71ba7-bd4a-4d4b-b9ea-bcff3d0a2320 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017686 Dec 17 12:30:53.708067 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:53.717717 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-348a1867-ac09-48a6-bfc5-2201fd752384 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:53.723217 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.wsgi [None req-348a1867-ac09-48a6-bfc5-2201fd752384 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 17 12:30:53.723779 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-348a1867-ac09-48a6-bfc5-2201fd752384 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:53.724560 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-348a1867-ac09-48a6-bfc5-2201fd752384 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010384 Dec 17 12:30:53.725044 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Dec 17 12:30:53 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 17 12:30:55.209672 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-dce71ba7-bd4a-4d4b-b9ea-bcff3d0a2320 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:55.210710 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-dce71ba7-bd4a-4d4b-b9ea-bcff3d0a2320 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Dec 17 12:30:55.211220 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:30:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:55.412914 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-3152db8e-224a-4b57-ae47-c74ac122799c admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:55.418168 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.wsgi [None req-3152db8e-224a-4b57-ae47-c74ac122799c admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 17 12:30:55.418720 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-3152db8e-224a-4b57-ae47-c74ac122799c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:55.419499 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-3152db8e-224a-4b57-ae47-c74ac122799c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072718 Dec 17 12:30:55.419990 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:30:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 17 12:30:55.433006 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-a7145063-4fe7-4566-9561-98f3205baf46 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:55.448443 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-a7145063-4fe7-4566-9561-98f3205baf46 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021408 Dec 17 12:30:55.449312 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:55.460903 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:55.473780 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017901 Dec 17 12:30:55.474339 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Dec 17 12:30:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:30:55.484167 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-d211cd74-663e-4328-b7d6-bdaa33667474 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:55.492969 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.wsgi [None req-d211cd74-663e-4328-b7d6-bdaa33667474 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 17 12:30:55.493567 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-d211cd74-663e-4328-b7d6-bdaa33667474 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:30:55.494368 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-d211cd74-663e-4328-b7d6-bdaa33667474 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013922 Dec 17 12:30:55.494885 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:30:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 17 12:30:56.970221 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:56.971276 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 17 12:30:56.971659 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:30:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:57.172450 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3f8e193e-708d-4b1e-9b51-14567f7e8a04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:57.194221 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3f8e193e-708d-4b1e-9b51-14567f7e8a04 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076801 Dec 17 12:30:57.194759 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Dec 17 12:30:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:30:58.667466 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:30:58.668469 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 17 12:30:58.668887 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:30:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:30:58.867103 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-87f1a47c-e240-4af0-97a6-956e6a2047ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:30:58.892500 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-87f1a47c-e240-4af0-97a6-956e6a2047ba admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084329 Dec 17 12:30:58.893038 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Dec 17 12:30:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:31:00.384132 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:00.385123 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Dec 17 12:31:00.385537 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:31:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:31:00.593690 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-304bf018-e4e3-4368-8b43-5773eb91caf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:31:00.619754 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-304bf018-e4e3-4368-8b43-5773eb91caf7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.093436 Dec 17 12:31:00.620494 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Dec 17 12:31:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:31:02.114141 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:02.115130 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Dec 17 12:31:02.115517 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:31:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:31:02.317158 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-565b94da-4f9c-44c5-b315-7ae61bd55d46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:31:02.338373 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-565b94da-4f9c-44c5-b315-7ae61bd55d46 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085865 Dec 17 12:31:02.338925 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Dec 17 12:31:02 2021] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:31:03.809169 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:03.810195 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 17 12:31:03.810583 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:31:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:31:04.020213 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-8451cc8f-c6d3-47fc-a538-e9d3f013ecf8 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:04.039436 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-8451cc8f-c6d3-47fc-a538-e9d3f013ecf8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.087793 Dec 17 12:31:04.040329 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Fri Dec 17 12:31:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:31:51.540138 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.541136 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-1ddc5016-9286-4764-8bea-8b400a3b8613 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Dec 17 12:31:51.541583 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:31:51.608045 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-a63aebea-d03b-402d-a3a1-a35ac52d3418 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.627021 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-a63aebea-d03b-402d-a3a1-a35ac52d3418 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078898 Dec 17 12:31:51.627532 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:31:51.649849 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-9fbd866c-f8cf-4a64-a5b0-f3628122c979 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.658205 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-9fbd866c-f8cf-4a64-a5b0-f3628122c979 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011818 Dec 17 12:31:51.658731 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:31:51.670365 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-f9b3eed4-835e-4077-a1ea-7d10b2dccf2c admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.677956 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-f9b3eed4-835e-4077-a1ea-7d10b2dccf2c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011057 Dec 17 12:31:51.678462 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:31:51.690040 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-917a4a9b-a10e-4502-969c-746e5eaa1e6f admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.697601 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-917a4a9b-a10e-4502-969c-746e5eaa1e6f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011008 Dec 17 12:31:51.698109 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:31:51.709815 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:31:51.717605 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011222 Dec 17 12:31:51.718121 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Dec 17 12:31:51 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:33:15.259873 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-fafe0966-b8a3-46c3-a9c9-64452a873d1c tempest-verify_tempest_config-740118233 tempest-verify_tempest_config-740118233-project] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:33:15.261877 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-fafe0966-b8a3-46c3-a9c9-64452a873d1c tempest-verify_tempest_config-740118233 tempest-verify_tempest_config-740118233-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121892 Dec 17 12:33:15.262453 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 34/69] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Dec 17 12:33:15 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:34:47.597571 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:34:47.599225 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Dec 17 12:34:47.599647 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:34:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:34:47.869613 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:34:47.870969 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:34:47.870969 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:34:47.872580 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:34:47.873017 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:34:47.873869 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:34:47.874297 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:34:47.910307 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-7e3e8b2a-3227-4d76-88da-9c29abe982c2 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.168981 Dec 17 12:34:47.911046 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 35/71] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:34:47 2021] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:34:49.399865 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:34:49.400879 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 17 12:34:49.401309 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 37/72] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:34:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:34:49.615853 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:34:49.617032 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:34:49.617032 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:34:49.618643 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:34:49.619085 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:34:49.619877 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:34:49.620301 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:34:49.638978 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-e7167082-5bf0-4125-bff5-9e94aa111d23 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098760 Dec 17 12:34:49.639530 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 36/73] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:34:49 2021] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:35:01.582223 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:35:01.583222 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 17 12:35:01.583621 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 38/74] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:35:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:35:01.784559 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:35:01.785759 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:35:01.785759 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:35:01.787274 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:35:01.787717 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:35:01.788509 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:35:01.788935 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:35:01.812795 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-b0e2cbbd-e2e6-46d2-a849-54e1face33fd admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088004 Dec 17 12:35:01.813376 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 37/75] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:35:01 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:35:03.334858 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: DEBUG nova.api.openstack.wsgi [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] Calling method '>' {{(pid=101868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:35:03.335877 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: INFO nova.api.openstack.requestlog [None req-3432ffe5-2144-4797-ae04-3d1517bc87e0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Dec 17 12:35:03.336291 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: [pid: 101868|app: 0|req: 39/76] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Dec 17 12:35:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:35:03.537470 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG nova.api.openstack.wsgi [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] Calling method '>' {{(pid=101869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:35:03.538551 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:35:03.538551 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: warnings.warn(msg) Dec 17 12:35:03.540053 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:35:03.540493 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:35:03.541312 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:35:03.541721 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: DEBUG oslo_concurrency.lockutils [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:35:03.562317 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: INFO nova.api.openstack.requestlog [None req-4fd03e73-d107-46a1-8780-e5dd1b625403 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085722 Dec 17 12:35:03.562853 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: [pid: 101869|app: 0|req: 38/77] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Dec 17 12:35:03 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:36:00.449154 dv-cinder-801522-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 17 12:36:00.449853 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: Fri Dec 17 12:36:00 2021 - graceful shutdown triggered... Dec 17 12:36:00.450317 dv-cinder-801522-9-iscsi devstack@n-api.service[101868]: Gracefully killing worker 1 (pid: 101868)... Dec 17 12:36:00.450693 dv-cinder-801522-9-iscsi devstack@n-api.service[101869]: Gracefully killing worker 2 (pid: 101869)... Dec 17 12:36:01.450967 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: worker 1 buried after 1 seconds Dec 17 12:36:01.450967 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: worker 2 buried after 1 seconds Dec 17 12:36:01.450967 dv-cinder-801522-9-iscsi devstack@n-api.service[101867]: goodbye to uWSGI. Dec 17 12:36:01.453995 dv-cinder-801522-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 17 12:36:01.454888 dv-cinder-801522-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 17 12:36:01.459040 dv-cinder-801522-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 17 12:36:01.470559 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 17 12:36:01.473793 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 17 12:36:01 2021] *** Dec 17 12:36:01.473985 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 17 12:36:01.474162 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 17 12:36:01.474300 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: nodename: dv-cinder-801522-9-iscsi Dec 17 12:36:01.474431 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: machine: x86_64 Dec 17 12:36:01.474563 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: clock source: unix Dec 17 12:36:01.474706 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: pcre jit disabled Dec 17 12:36:01.474840 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: detected number of CPU cores: 4 Dec 17 12:36:01.474971 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: current working directory: / Dec 17 12:36:01.475110 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: detected binary path: /usr/bin/uwsgi-core Dec 17 12:36:01.475258 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: your processes number limit is 47680 Dec 17 12:36:01.475407 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: your memory page size is 4096 bytes Dec 17 12:36:01.475543 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: detected max file descriptor number: 2048 Dec 17 12:36:01.475687 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: lock engine: pthread robust mutexes Dec 17 12:36:01.476032 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: thunder lock: enabled Dec 17 12:36:01.476456 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 17 12:36:01.476650 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 17 12:36:01.523290 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: Python main interpreter initialized at 0x561d914a99c0 Dec 17 12:36:01.523290 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: python threads support enabled Dec 17 12:36:01.523290 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: your server socket listen backlog is limited to 100 connections Dec 17 12:36:01.523290 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: your mercy for graceful operations on workers is 90 seconds Dec 17 12:36:01.523772 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: mapped 403077 bytes (393 KB) for 2 cores Dec 17 12:36:01.523772 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: *** Operational MODE: preforking *** Dec 17 12:36:01.524032 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: *** uWSGI is running in multiple interpreter mode *** Dec 17 12:36:01.524032 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: spawned uWSGI master process (pid: 127702) Dec 17 12:36:01.524235 dv-cinder-801522-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 17 12:36:01.524814 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: spawned uWSGI worker 1 (pid: 127716, cores: 1) Dec 17 12:36:01.525363 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: spawned uWSGI worker 2 (pid: 127717, cores: 1) Dec 17 12:36:01.525670 dv-cinder-801522-9-iscsi devstack@n-api.service[127702]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 17 12:36:03.401349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:36:03.401349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: from cryptography.utils import int_from_bytes Dec 17 12:36:03.402122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:36:03.402122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: from cryptography.utils import int_from_bytes Dec 17 12:36:03.409790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:36:03.409790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: from cryptography.utils import int_from_bytes Dec 17 12:36:03.410334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 17 12:36:03.410334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: from cryptography.utils import int_from_bytes Dec 17 12:36:05.814003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 17 12:36:05.814661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 17 12:36:05.814753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 17 12:36:05.815178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 17 12:36:05.815451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 17 12:36:05.815784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.816109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.816442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.816548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 17 12:36:05.816931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.817013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 17 12:36:05.817095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.817334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 17 12:36:05.817442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.817692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 17 12:36:05.817802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.817952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 17 12:36:05.818049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.818331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.818430 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.818589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.818695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.818914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-9-iscsi {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.819980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.820972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.821130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.821322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.821495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.821637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.826564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-9-iscsi {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.826845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.827126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.827361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.827602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.827841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.828055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.828265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.828485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.828711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.828930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.829137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.829345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.829694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.829935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.830582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.830798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.831022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.831223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.831442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.831668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.831848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-9-iscsi {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.832877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.833862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834011 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-9-iscsi {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.834925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.835074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.835226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.835374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.835513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.835851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.837523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.837693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.837846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.837996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.838899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.839848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.841201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.841412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.841561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.841715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.841866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.842950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.843109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.843253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.843398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.843827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.843983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.844134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.844291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.845423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.846936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.847079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.847533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.847709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.847852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848630 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.848924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.849913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.850091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.850549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.850712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.850854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.851893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.852955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.853967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.854970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.855257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.855487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.855639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.855781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.855931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.856957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.857114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.857262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.857581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.857824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.857980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.858877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.859895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.860045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.860185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.861213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.861421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.861658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.861820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.861963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.862878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.863754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.864973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.865122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.865263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.865545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.865712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.865870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.866948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.867087 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.867235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.867376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.867532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.867898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.868919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.869975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.870130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.870278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.870646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.870796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.870937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.871960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.872125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.872278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.872426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.872573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.872714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.872714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.872995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.873143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.873355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.873502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.873642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.873800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.874063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.874231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.874379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.874526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.874666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.874910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.875064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.875206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 17 12:36:05.875353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.875353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.875717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.875904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.876934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.877081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.877222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.877396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.877547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.877815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.878206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.878484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.878654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.878811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.878962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.879858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.880013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.880153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.880300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.880782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.880943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.881954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.882849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.883739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.884135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.884296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.884438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.884577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.884866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.885954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.886983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.887961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.888957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.889904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.890168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.890315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.890462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.890616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.890938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.891079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.891242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.891391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.891702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.891851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.892898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.893958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.894183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.894351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.894500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.894641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.894874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.895962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.896988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.897904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.898986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.899938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.900962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.901982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902577 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.902864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.903937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.904962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.905195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.905195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.905526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.905678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.905840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.906967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.907851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.908032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.908276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.908452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.908702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.908850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.909891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.910763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.911882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.912899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.913985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.914995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.915349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.915516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.915668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.915668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.915946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.916905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.917983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.918124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.918292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.918518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.918663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.918924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.919936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.920839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.921904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.922834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.923890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924260 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.924941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.925096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.925472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.925634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.925775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.925913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.926899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.927930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.928963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.929217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.929388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.929529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.929691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.929853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.930946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.931086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.931405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.931561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.931702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.931866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.932986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.933875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.934963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.935998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.936958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.937949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.938997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.939917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.940938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.941914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.942954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.943915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944289 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.944922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.945984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.946980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.947942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.948967 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.949949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.950974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.951943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.952966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.953937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.954985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.955979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.956949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.957938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.958946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959555 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.959965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.960989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.961949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.962947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.963966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.964975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.965217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.965401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.965530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.965641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.965747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.966226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.966393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.966557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.966707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.966853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.967981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.968923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.969933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.970991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.971998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.972217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.972390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.972539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.972687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.972835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.973979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.974232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.974364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.974559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.974696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.974871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.975960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.976937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977569 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.977992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.978882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.979860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.980794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.981977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.982915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.983969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.984941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.985912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.986924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.987934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.988904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.989906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.990851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.991800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.992959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.993913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.994863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.995021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.995207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.995904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.996954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.997042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.997301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.997466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.997634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.997915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.998014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.998352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.998523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.998796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.998885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.999167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.999256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.999486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:05.999688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.000847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.000968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.001976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.002846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.003980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.004981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.005080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.005334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.005486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.005662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.005987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.006309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.006624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.006741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.006943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.007035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.007259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.007355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008329 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.008892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.009908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.010904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.011872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.012813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.013856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.014835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.015803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.016885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.017970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.018077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.018311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.018570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.018674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.018907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.019979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.020916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.021894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.022962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.023962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.024918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.025973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.026919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.027854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.028990 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.029962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.030997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.031219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.031311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.031549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.031702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.031878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.032059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.032269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.032533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.032854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.033105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.033451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.033562 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.033850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.033953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.034913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.035159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.035472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.035785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.036116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.036432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.036749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.037065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.037405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.037531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.037726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.038998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.039089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.039320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.039409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.039669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.039768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.040992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.041088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.041354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.041664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.041775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.041980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.042966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.043264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.043367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.043589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.043696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.043914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.044910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.045134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.045226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.045508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.045659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.045822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.046867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.047895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.048930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.049129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.049289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.049507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.049678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.049823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.050974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.051201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.051329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.051527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.051657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.051873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.052964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.053940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.054894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.055841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.056825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.057834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.058857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.059942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.060915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.061914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.062968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.063906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.064171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.064338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.064426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 17 12:36:06.064516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.064773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.065103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.065447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.065774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.066093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.066408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.066741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.067055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.067373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.067687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.068001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.068322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.068637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.068968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.069360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.069651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.069983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.070335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.070650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.071000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.071333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.071651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.071966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.072277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 17 12:36:06.072525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 17 12:36:06.088118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.095400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_db.sqlalchemy.engines [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.155242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.context [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70d6da78-ff38-4fe6-9546-7442c31f6ddc(cell1) {{(pid=127716) load_cells /opt/stack/nova/nova/context.py:464}} Dec 17 12:36:06.159670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:06.161291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:06.162101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.context [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70d6da78-ff38-4fe6-9546-7442c31f6ddc(cell1) {{(pid=127717) load_cells /opt/stack/nova/nova/context.py:464}} Dec 17 12:36:06.162220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:06.164127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:06.166436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:06.168039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:06.169171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:06.170890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:06.177102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.179313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.184347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_db.sqlalchemy.engines [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.186832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_db.sqlalchemy.engines [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.344575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_db.sqlalchemy.engines [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.357402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_db.sqlalchemy.engines [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 17 12:36:06.667721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:36:06.674526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:36:06.677932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: WARNING keystonemiddleware.auth_token [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:36:06.684563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: WARNING keystonemiddleware.auth_token [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:36:07.018725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:36:07.024659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: WARNING keystonemiddleware.auth_token [None req-de2ab60a-ef3c-4712-b147-a5e514f14b54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:36:07.025237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: WARNING keystonemiddleware.auth_token [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 17 12:36:07.030095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d914a99c0 pid: 127716 (default app) Dec 17 12:36:07.030421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: WARNING keystonemiddleware.auth_token [None req-702f2063-a659-4119-9c07-60f4de83c2c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 17 12:36:07.035838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d914a99c0 pid: 127717 (default app) Dec 17 12:36:41.199031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3396f086-624e-4293-9dd5-f39354df2cba tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Action: 'create', calling method: .version_select at 0x7fba132b4e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1288525737", "metadata": {"Type": "work"}}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:41.855159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-37435701", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "1738f8ac-3144-4a29-8c86-ab024ec61052"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:42.628227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] validate_networks() for [('1738f8ac-3144-4a29-8c86-ab024ec61052', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:36:43.211290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3396f086-624e-4293-9dd5-f39354df2cba tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.384382 Dec 17 12:36:43.212227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Dec 17 12:36:39 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3387 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 17 12:36:43.544292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1305385640", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "d9f66e5e-7ac9-4a27-81d2-56c3a98df434"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:43.688766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] validate_networks() for [('d9f66e5e-7ac9-4a27-81d2-56c3a98df434', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:36:43.895468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:36:43.896837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:36:43.897344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:36:43.905119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:36:43.905642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:36:43.926015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:43.926860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:43.928676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:43.929366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:43.967932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:36:43.975499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for user 45f9bd776357421f97fb8530da002ef0 and project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:36:43.990463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:36:43.994170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:36:44.115943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9abfad8b-5c1c-45c3-aa9c-111874628430 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.672895 Dec 17 12:36:44.122616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:36:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 3682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:36:44.129185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e08c0f04-1133-4c71-ba6a-ee622c687b33 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Calling method '.version_select at 0x7fba128b0820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:44.245201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e08c0f04-1133-4c71-ba6a-ee622c687b33 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7" status: 200 len: 354 microversion: 2.1 time: 0.120012 Dec 17 12:36:44.245472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:44 2021] GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:44.255422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-75a74d88-45e5-42a8-bd48-30d71ac1c5d8 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba128b0ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:44.337933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-75a74d88-45e5-42a8-bd48-30d71ac1c5d8 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/50653ba2-120c-44a6-bf16-129916fa9c9a" status: 200 len: 350 microversion: 2.1 time: 0.087423 Dec 17 12:36:44.339116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:44 2021] GET /compute/v2.1/os-volumes/50653ba2-120c-44a6-bf16-129916fa9c9a => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:44.344061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5ef2c65b-3ca5-48fd-9ba1-2d8610b90e0d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:44.353942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5ef2c65b-3ca5-48fd-9ba1-2d8610b90e0d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:44.539187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5ef2c65b-3ca5-48fd-9ba1-2d8610b90e0d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:44.566344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5ef2c65b-3ca5-48fd-9ba1-2d8610b90e0d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1216 microversion: 2.1 time: 0.226233 Dec 17 12:36:44.583267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:44 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:44.595717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1988c938-a812-4a43-8f0d-f5a2b5e570e6 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Calling method '.version_select at 0x7fba12032ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:45.119982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1988c938-a812-4a43-8f0d-f5a2b5e570e6 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7" status: 200 len: 354 microversion: 2.1 time: 0.535307 Dec 17 12:36:45.132722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:44 2021] GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7 => generated 354 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:45.137908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dfe0579b-8461-4e74-b8df-0533b12b774d tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Calling method '.version_select at 0x7fba1204ce50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:45.371891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dfe0579b-8461-4e74-b8df-0533b12b774d tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7" status: 202 len: 0 microversion: 2.1 time: 0.237545 Dec 17 12:36:45.376544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Dec 17 12:36:45 2021] DELETE /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:36:45.383418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b11d23e2-2bb9-42e3-af9c-4adde1c5df14 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Calling method '.version_select at 0x7fba12056550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:45.481859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b11d23e2-2bb9-42e3-af9c-4adde1c5df14 tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7" status: 200 len: 353 microversion: 2.1 time: 0.103680 Dec 17 12:36:45.482429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:45 2021] GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:45.504480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:36:45.505157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:36:45.505662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:36:45.506154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:36:45.506645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:36:45.535295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:45.535746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:45.539067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:45.539712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:45.583540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-25ad0425-3156-4d18-9a7d-a92dc189564b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:45.584220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-25ad0425-3156-4d18-9a7d-a92dc189564b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:45.587476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Getting quotas for project 9ec5c5d371d64df6911f3561ce364e85. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:36:45.595860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Getting quotas for user 70a94a1ea58843baba3000670c6b5a83 and project 9ec5c5d371d64df6911f3561ce364e85. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:36:45.608818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:36:45.618138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:36:45.745455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-25ad0425-3156-4d18-9a7d-a92dc189564b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:45.753361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-25ad0425-3156-4d18-9a7d-a92dc189564b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1216 microversion: 2.1 time: 0.173651 Dec 17 12:36:45.753943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:45 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:45.769121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-008f9158-04cd-41ad-9ea3-96bc0ab3ea66 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.554783 Dec 17 12:36:45.770161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 2/10] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:36:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:36:45.780169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ecf2d3ba-f3a1-41e4-87e9-32b1e05c4a8c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:45.780776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ecf2d3ba-f3a1-41e4-87e9-32b1e05c4a8c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:45.884927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ecf2d3ba-f3a1-41e4-87e9-32b1e05c4a8c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:45.899380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ecf2d3ba-f3a1-41e4-87e9-32b1e05c4a8c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1215 microversion: 2.1 time: 0.122846 Dec 17 12:36:45.909403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 9/11] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:45 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:46.428533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-428310e3-5eb0-450c-a2cf-773147c77d49 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba1309b1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:46.494490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92ade556-bb91-43f0-a19d-ee9c08ea195b tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Calling method '.version_select at 0x7fba13131160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:46.565657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-428310e3-5eb0-450c-a2cf-773147c77d49 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fc6cd480-336e-4191-804c-cef19eb68a01" status: 200 len: 350 microversion: 2.1 time: 0.143225 Dec 17 12:36:46.567665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 3/12] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:46 2021] GET /compute/v2.1/os-volumes/fc6cd480-336e-4191-804c-cef19eb68a01 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:46.601891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-92ade556-bb91-43f0-a19d-ee9c08ea195b tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] HTTP exception thrown: Volume ad39cf1d-8416-4616-aa5d-31e32ac895b7 could not be found. Dec 17 12:36:46.602510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92ade556-bb91-43f0-a19d-ee9c08ea195b tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] Returning 404 to user: Volume ad39cf1d-8416-4616-aa5d-31e32ac895b7 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:46.603401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92ade556-bb91-43f0-a19d-ee9c08ea195b tempest-VolumesGetTestJSON-623365945 tempest-VolumesGetTestJSON-623365945-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7" status: 404 len: 109 microversion: 2.1 time: 0.113179 Dec 17 12:36:46.604081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 10/13] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:46 2021] GET /compute/v2.1/os-volumes/ad39cf1d-8416-4616-aa5d-31e32ac895b7 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 17 12:36:46.769815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:46.770688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:46.794099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:46.794908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:46.796081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:46.796719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:46.917066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-356ed2eb-27cf-4699-85d2-44e7d5b81895 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:46.917889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-356ed2eb-27cf-4699-85d2-44e7d5b81895 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:47.274893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:47.307599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69807b58-0822-43b9-baec-be196df07ec7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1212 microversion: 2.1 time: 0.541545 Dec 17 12:36:47.318951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 4/14] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:46 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1212 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:47.445298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-356ed2eb-27cf-4699-85d2-44e7d5b81895 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:47.457162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-356ed2eb-27cf-4699-85d2-44e7d5b81895 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1215 microversion: 2.1 time: 0.543477 Dec 17 12:36:47.468345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 11/15] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:46 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1215 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:48.347164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:48.350850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:48.369192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:48.372602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:48.374224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:48.382835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:48.476347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:48.476978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:48.499903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:48.502292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:48.509023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:48.512082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:48.798521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:48.815136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ebef7294-f597-4c4a-b962-a2733e361743 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1274 microversion: 2.1 time: 0.485207 Dec 17 12:36:48.817377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 5/16] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:48 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1274 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:49.022930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:49.042731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-313a7cdf-8c58-4525-b627-1d1cd54ce86f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1275 microversion: 2.1 time: 0.570996 Dec 17 12:36:49.043324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 12/17] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:48 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1275 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:49.450985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d1b2875f-656b-4c54-a842-514ce3d88f54 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11fda040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:49.539586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d1b2875f-656b-4c54-a842-514ce3d88f54 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1123813a-9e8b-4ad3-a604-dba2accc43a6" status: 200 len: 351 microversion: 2.1 time: 0.092807 Dec 17 12:36:49.540767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:49 2021] GET /compute/v2.1/os-volumes/1123813a-9e8b-4ad3-a604-dba2accc43a6 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:49.552585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26c0922d-f6e9-4c70-94fa-2a9a51994e94 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f87b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:49.735264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26c0922d-f6e9-4c70-94fa-2a9a51994e94 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.186281 Dec 17 12:36:49.744443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 14/19] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Dec 17 12:36:49 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:49.776808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4db6bd64-8b90-486e-9335-166c53a7cb2b tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f93700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:50.073999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4db6bd64-8b90-486e-9335-166c53a7cb2b tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.328171 Dec 17 12:36:50.076349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 15/20] 10.222.0.45 () {58 vars in 1148 bytes} [Fri Dec 17 12:36:49 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:50.085189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:50.087898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:50.095365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:50.095879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:50.096904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:50.097396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:50.131173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'create', calling method: .version_select at 0x7fba11f6bdc0>, body: {"keypair": {"name": "tempest-keypair-1275089504"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:50.229129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:36:50.237306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:36:50.291085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:50.305718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d197e95-fc43-471a-ae5e-d565d68e8b24 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1274 microversion: 2.1 time: 0.227868 Dec 17 12:36:50.313528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 16/21] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:50 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:50.320532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:50.352545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:50.390488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:50.391567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:50.394941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:50.411608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:50.569973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:50.581903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-231f67b5-e5e6-4973-924b-635742035c12 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1273 microversion: 2.1 time: 0.263065 Dec 17 12:36:50.584898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 17/22] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:50 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:50.599650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a9d37b93-ff62-4c6c-9331-932a801d29d8 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f873a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:50.845490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a9d37b93-ff62-4c6c-9331-932a801d29d8 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.258790 Dec 17 12:36:50.846764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 18/23] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Dec 17 12:36:50 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:50.859980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fa81116d-e699-4de3-8bfd-63eb9b12a663 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11fbee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:51.098150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fa81116d-e699-4de3-8bfd-63eb9b12a663 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243639 Dec 17 12:36:51.098930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 19/24] 10.222.0.45 () {58 vars in 1166 bytes} [Fri Dec 17 12:36:50 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:51.110898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6cb36e95-e6e1-4735-b17a-f28377f5c214 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f2b9d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:51.306968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6cb36e95-e6e1-4735-b17a-f28377f5c214 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.199973 Dec 17 12:36:51.307803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 20/25] 10.222.0.45 () {58 vars in 1169 bytes} [Fri Dec 17 12:36:51 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:51.321754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c25e932-38e0-43d3-abd5-8ac8fa12f77c tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f2b310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:51.623908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c25e932-38e0-43d3-abd5-8ac8fa12f77c tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.306138 Dec 17 12:36:51.624851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 21/26] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Dec 17 12:36:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:36:51.629835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:51.631180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:51.648247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:51.648947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:51.651062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:51.653423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:51.860101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:36:51.876604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:36:51.896471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:51.907444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4c5d9927-b1a3-4e14-8d86-df7ab9823c11 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.281069 Dec 17 12:36:51.908518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 22/27] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:51 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:51.914633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:51.915502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:51.922887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:51.923429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2b50e5f-cbe1-4535-af7a-e0f6b17e4b97 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.567812 Dec 17 12:36:51.924650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:51.926429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:51.927185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:51.928047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 6/28] 10.222.0.45 () {62 vars in 1198 bytes} [Fri Dec 17 12:36:49 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2572 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 17 12:36:51.943810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-54c690ab-5fd8-41e0-9538-85c21cc31fd6 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11fb99d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:52.247783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-54c690ab-5fd8-41e0-9538-85c21cc31fd6 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.318594 Dec 17 12:36:52.248374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 7/29] 10.222.0.45 () {58 vars in 1187 bytes} [Fri Dec 17 12:36:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:52.261839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2724ac39-12e8-458e-83ea-83e934bb07b3 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] Calling method '.version_select at 0x7fba11f8cf70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:52.284277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:52.294399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-96ee1cbf-d070-4e46-a984-b53c098a5a30 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.384645 Dec 17 12:36:52.306507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 23/30] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:51 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:52.454472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2724ac39-12e8-458e-83ea-83e934bb07b3 tempest-VolumesTestJSON-765440790 tempest-VolumesTestJSON-765440790-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197274 Dec 17 12:36:52.455143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 8/31] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Dec 17 12:36:52 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:52.925114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:52.926539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:52.940897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:52.942215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:52.946175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:52.948568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:53.319268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:53.320118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:53.336086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:53.336743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:53.350928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:53.351407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:53.639158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:53.654796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7633a430-81cf-4966-9da3-0694004240cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.733485 Dec 17 12:36:53.673728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 24/32] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:52 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:54.675357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:54.676453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:54.716885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:54.723536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:54.732164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:54.734567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:55.190223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:55.198531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd78da52-ef50-4058-9601-e3e90cfdc01f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 1.889587 Dec 17 12:36:55.221854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 9/33] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:53 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:55.652715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:55.668292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-572a338b-2c98-40a1-96fa-1026416b8566 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.998929 Dec 17 12:36:55.678526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 25/34] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:54 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:36:56.225088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:56.226482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:56.235792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:56.237823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:56.239028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:56.241574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:56.582394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1274909093", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "983c631a-ec8e-4363-87f4-66a72eb9c7a6"}], "security_groups": [{"name": "tempest-securitygroup--1337392884"}], "key_name": "tempest-keypair-1275089504", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:57.028783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] validate_networks() for [('983c631a-ec8e-4363-87f4-66a72eb9c7a6', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:36:57.898118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:57.917818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3c7d579c-c88d-4e3f-b294-f113460afcc6 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 1.698122 Dec 17 12:36:57.929856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 10/35] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:56 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:57.947330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:57.954975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:57.972698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:57.989083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:57.993383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:57.993972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.180757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:36:58.184511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:36:58.186964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:36:58.189022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:36:58.189686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:36:58.210580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.212975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.221738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.222398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.295664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:36:58.306342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:58.312981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:36:58.315206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-784d6d6b-1fb5-45cb-9cba-8c5fd8236eee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.383363 Dec 17 12:36:58.325599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 11/36] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:57 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:58.330452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:36:58.334159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:36:58.488354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2517e485-ccab-410e-ba09-0afc86a5414a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.909134 Dec 17 12:36:58.496753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 26/37] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Dec 17 12:36:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 17 12:36:58.510665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:58.513462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:58.658854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:58.670908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:58.672459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:58.687170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7cf41506-de65-4f52-be02-f32867572f1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1282 microversion: 2.20 time: 0.174264 Dec 17 12:36:58.688053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 27/38] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:36:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:36:58.716865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-e8f2803e-36f9-46bc-9e61-d2e12190e8ac req-ab06cd45-1733-48f6-8f32-7dd1228a3e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c28864-8d42-45d6-90c4-e7cb6c3e3c24", "tag": "37a0972d-1242-406b-b7c5-f0f02924f739"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:58.719093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:36:58.719093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:36:58.737085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e8f2803e-36f9-46bc-9e61-d2e12190e8ac req-ab06cd45-1733-48f6-8f32-7dd1228a3e70 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.737577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e8f2803e-36f9-46bc-9e61-d2e12190e8ac req-ab06cd45-1733-48f6-8f32-7dd1228a3e70 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.768856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-e8f2803e-36f9-46bc-9e61-d2e12190e8ac req-ab06cd45-1733-48f6-8f32-7dd1228a3e70 service nova] Creating event network-changed:37a0972d-1242-406b-b7c5-f0f02924f739 for instance 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 on hv-cinder-80152 Dec 17 12:36:58.769434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e8f2803e-36f9-46bc-9e61-d2e12190e8ac req-ab06cd45-1733-48f6-8f32-7dd1228a3e70 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 17 12:36:58.770933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.771518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.772648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.773258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.782305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.compute.rpcapi [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 17 12:36:58.783264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] Releasing lock "compute-rpcapi-router" {{(pid=127716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 17 12:36:58.809395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d3de824b-08f9-4258-9d02-b2bcfa4c84bd None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472629 Dec 17 12:36:58.810247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 12/39] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:36:58.949112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:58.949803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:58.957920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.958581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:58.959822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:58.960432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:59.170084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:59.180341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-280adee9-be3d-4ac3-8231-1fbc623c8091 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.237186 Dec 17 12:36:59.191285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 28/40] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:58 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:36:59.342053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:59.342755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:59.350622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:59.351935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:59.353459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:59.354538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:59.382751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82c56c3a-e400-4be7-8377-a8a871946763 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Action: 'create', calling method: .version_select at 0x7fba11f30dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-562142525", "metadata": {"Type": "work"}}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:59.384150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82c56c3a-e400-4be7-8377-a8a871946763 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.384957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-82c56c3a-e400-4be7-8377-a8a871946763 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135833 Dec 17 12:36:59.385521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 13/41] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Dec 17 12:36:59 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:36:59.394317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-40dfef00-25af-4b26-9210-0c9dd87042f9 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Action: 'create', calling method: .version_select at 0x7fba11f36e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-305422269", "metadata": {"Type": "work"}}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:59.396065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-40dfef00-25af-4b26-9210-0c9dd87042f9 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.396871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-40dfef00-25af-4b26-9210-0c9dd87042f9 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006026 Dec 17 12:36:59.401628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 14/42] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Dec 17 12:36:59 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:36:59.406681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4d67791-a589-42a8-8f0a-ea3a6c31678b tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Action: 'create', calling method: .version_select at 0x7fba13b044c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-695561857", "metadata": {"Type": "work"}}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:36:59.407906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4d67791-a589-42a8-8f0a-ea3a6c31678b tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.408700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a4d67791-a589-42a8-8f0a-ea3a6c31678b tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005749 Dec 17 12:36:59.409223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 15/43] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Dec 17 12:36:59 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:36:59.417500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c86defb4-e107-446e-8349-661fcea99375 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Calling method '.version_select at 0x7fba11fcd1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:59.445481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-c86defb4-e107-446e-8349-661fcea99375 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] HTTP exception thrown: Volume tempest-invalid-743992392 could not be found. Dec 17 12:36:59.446083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c86defb4-e107-446e-8349-661fcea99375 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 404 to user: Volume tempest-invalid-743992392 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.446914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c86defb4-e107-446e-8349-661fcea99375 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-743992392" status: 404 len: 98 microversion: 2.1 time: 0.032748 Dec 17 12:36:59.447631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 16/44] 10.222.0.45 () {58 vars in 1214 bytes} [Fri Dec 17 12:36:59 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-743992392 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 17 12:36:59.456319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9eeeac20-2201-4ecb-9545-ac4cd49521e7 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003846 Dec 17 12:36:59.456827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 17/45] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Dec 17 12:36:59 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 17 12:36:59.464475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b4b2073-f82b-4780-8299-3373615a14e2 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003175 Dec 17 12:36:59.464987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 18/46] 10.222.0.45 () {58 vars in 1136 bytes} [Fri Dec 17 12:36:59 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 17 12:36:59.472898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5cea0ac7-e231-42ea-9919-8e51c9f2abc4 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Calling method '.version_select at 0x7fba13b04670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:59.490748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:59.498324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d28cdaba-fdc8-4d9f-add5-f84ded166223 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.160031 Dec 17 12:36:59.498935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 29/47] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:36:59 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:36:59.500173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-5cea0ac7-e231-42ea-9919-8e51c9f2abc4 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] HTTP exception thrown: Volume 75e7e95b-ca60-44fa-8d45-90887dc5d445 could not be found. Dec 17 12:36:59.500780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5cea0ac7-e231-42ea-9919-8e51c9f2abc4 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 404 to user: Volume 75e7e95b-ca60-44fa-8d45-90887dc5d445 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.501705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5cea0ac7-e231-42ea-9919-8e51c9f2abc4 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/75e7e95b-ca60-44fa-8d45-90887dc5d445" status: 404 len: 109 microversion: 2.1 time: 0.032151 Dec 17 12:36:59.502258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 19/48] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Dec 17 12:36:59 2021] DELETE /compute/v2.1/os-volumes/75e7e95b-ca60-44fa-8d45-90887dc5d445 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:36:59.511337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bad562cc-382f-4e36-b6ec-a440c9661899 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Calling method '.version_select at 0x7fba1204c3a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:59.537412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-bad562cc-382f-4e36-b6ec-a440c9661899 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] HTTP exception thrown: Volume 5dc764dd-6cca-45e8-b87f-eae12e35ade1 could not be found. Dec 17 12:36:59.538066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bad562cc-382f-4e36-b6ec-a440c9661899 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] Returning 404 to user: Volume 5dc764dd-6cca-45e8-b87f-eae12e35ade1 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:36:59.538927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bad562cc-382f-4e36-b6ec-a440c9661899 tempest-VolumesNegativeTest-111289754 tempest-VolumesNegativeTest-111289754-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5dc764dd-6cca-45e8-b87f-eae12e35ade1" status: 404 len: 109 microversion: 2.1 time: 0.031166 Dec 17 12:36:59.539510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 30/49] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:36:59 2021] GET /compute/v2.1/os-volumes/5dc764dd-6cca-45e8-b87f-eae12e35ade1 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:36:59.713921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:36:59.714741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:36:59.721935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:59.722292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:59.723203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:36:59.723675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:36:59.782820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:59.790791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:59.792356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:36:59.793476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eaa681ba-9747-4552-bc6a-2fa4921a530c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.084200 Dec 17 12:36:59.794043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 20/50] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:36:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:00.197922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:00.198530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:00.205931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.206388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.207237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.207672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.343283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:00.351877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7866d54f-7690-42bc-bbbe-e629380ea6b5 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.157438 Dec 17 12:37:00.355968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 31/51] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:00 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:00.513770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:00.514366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:00.520506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.520955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.521783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.522209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.708702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:00.719186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4340a6d1-b816-46ac-93a1-3411da9613b0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.208991 Dec 17 12:37:00.720665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 21/52] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:00 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:00.811433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:00.812617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:00.820310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.821431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.822574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.823243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.833188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-a421bad6-0217-4983-8151-bb8e3367d1dc req-e981cf63-cee9-4aaa-9480-0ee0de79d159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bccb27-15b6-4808-a28e-5dce8b7485d6", "tag": "5ad96499-86e8-43cd-b369-21035e25bf77"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:00.835073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:37:00.835073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:37:00.849953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a421bad6-0217-4983-8151-bb8e3367d1dc req-e981cf63-cee9-4aaa-9480-0ee0de79d159 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:00.850403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-a421bad6-0217-4983-8151-bb8e3367d1dc req-e981cf63-cee9-4aaa-9480-0ee0de79d159 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:00.881335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-a421bad6-0217-4983-8151-bb8e3367d1dc req-e981cf63-cee9-4aaa-9480-0ee0de79d159 service nova] Creating event network-changed:5ad96499-86e8-43cd-b369-21035e25bf77 for instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 on hv-cinder-80152 Dec 17 12:37:00.887261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-a421bad6-0217-4983-8151-bb8e3367d1dc req-e981cf63-cee9-4aaa-9480-0ee0de79d159 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057692 Dec 17 12:37:00.888876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:00.890767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 22/53] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:37:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:00.898836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:00.901836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:00.903403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-88c94bff-7444-4cde-a173-1b16bc29e77e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.095701 Dec 17 12:37:00.904006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 32/54] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:01.371418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:01.372981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:01.392561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.393924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:01.395675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.396424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:01.742400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:01.746984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:01.755624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:01.756531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.756531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:01.757197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.757997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:01.763370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-846e5e1a-6372-43fa-81c5-ecf8a8c39d72 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.398450 Dec 17 12:37:01.764893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 23/55] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:01 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:01.901005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:01.916989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7ccfbe1a-eb47-4dfe-98fe-b819563b9c87 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.182828 Dec 17 12:37:01.922854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:01.924101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:01.925153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 33/56] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:01 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:01.934469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.934956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:01.936071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:01.936537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:02.091479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:02.101407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:02.106020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:02.110347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-838ee488-8296-4576-b726-04f732f1a0c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.192681 Dec 17 12:37:02.111362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 24/57] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:02.779681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:02.780300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:02.786573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:02.787298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:02.788418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:02.789040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:02.944559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:02.945196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:02.955823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:02.956381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:02.957209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:02.957681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:03.028281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:03.040389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4175c044-80cb-492b-9cd7-80093e0c7c20 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.264137 Dec 17 12:37:03.041476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 34/58] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:02 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:03.129422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:03.131190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:03.139380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:03.140573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:03.142031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:03.142774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:03.195841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:03.208614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-813b6bc3-dcfb-49ef-978b-d470db4f6e7a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.269212 Dec 17 12:37:03.210030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 25/59] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:02 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:03.244043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:03.256576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:03.258373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:03.260649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90e54fa9-c85c-4bc3-bb07-92f1b674d990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.136399 Dec 17 12:37:03.261327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 35/60] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:04.057267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:04.058055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:04.064315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.064873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.065767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.066270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.225927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:04.227468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:04.228136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:04.233914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-17a9454e-e6be-4992-81df-4b734e704530 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.180523 Dec 17 12:37:04.234493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 26/61] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:04 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:04.243549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.244334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.250085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.250729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.279022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:04.279792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:04.285997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.286657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.287514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:04.288077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:04.352103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:04.359972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:04.361653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:04.362833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e49c9dc-66b5-4473-b089-f0e21dd5f997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.087741 Dec 17 12:37:04.363578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 27/62] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:04.676686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:04.687640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-78321f0e-a60d-4ae2-bef6-d7e4532e8004 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.465099 Dec 17 12:37:04.688305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 36/63] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:04 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:05.251140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:05.251716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:05.259854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.260330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:05.261122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.261581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:05.380328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:05.381050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:05.387369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.388008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:05.389127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.389571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:05.391675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:05.401197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2dd5eab5-937e-4820-a27e-76def1ca2f9e tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.154035 Dec 17 12:37:05.410026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 28/64] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:05 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:05.449905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:05.458167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:05.459679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:05.460788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-29c0c6c6-f969-4419-8410-d6aef98ba269 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1286 microversion: 2.20 time: 0.084556 Dec 17 12:37:05.471133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 37/65] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:05.706684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:05.707327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:05.713613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.714039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:05.714918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:05.715295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:06.000119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:06.007633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f3f8a56-20ca-4ea2-9b15-4e91ce2a1fdc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.305243 Dec 17 12:37:06.008304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 29/66] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:05 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:06.418210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:06.418830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:06.425113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:06.425593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:06.426386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:06.426856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:06.480008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:06.480594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:06.486909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:06.487643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:06.488372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:06.488962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:06.558970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:06.567231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:06.568750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:06.572098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:06.579855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d138b543-52c6-43a7-8e16-1f1a4e8c644f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.165456 Dec 17 12:37:06.580760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 38/67] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:06 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:06.581083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b040f7fd-cf26-4100-bfb8-0c9dbde17a95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1278 microversion: 2.20 time: 0.104728 Dec 17 12:37:06.582063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 30/68] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:07.023842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:07.024429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:07.030289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.030734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.031556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.031992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.166641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:07.175055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9f59ac9b-81fa-4e9b-a211-ccb365d7d894 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.154909 Dec 17 12:37:07.176037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 39/69] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:07 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:07.596199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:07.596729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:07.604978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.605472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.606298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.606916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.608431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:07.609997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:07.619775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.620385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.621407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:07.622082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:07.684870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:07.693826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:07.695396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:07.696605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-39dc969a-48ca-498d-ad83-54be92faf498 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1278 microversion: 2.20 time: 0.094187 Dec 17 12:37:07.697257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 40/70] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:07.755532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:07.762818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f1e872e-71cc-4b99-84b7-6063ce259010 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.170544 Dec 17 12:37:07.763386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 31/71] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:07 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:08.191779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:08.192354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:08.200589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.201165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.202047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.202540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.330365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:08.338249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-07c43c96-c0a6-4fb0-87bf-f94060c7831e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.150098 Dec 17 12:37:08.338835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 41/72] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:08 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:08.714657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:08.715373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:08.721347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.721885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.722837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.723343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.779596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:08.780431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:08.783088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:08.787407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.787828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.788654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:08.789082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:08.794533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:08.796520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:08.798153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4579adef-a6d3-494c-8ef6-d940955b2d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1278 microversion: 2.20 time: 0.087195 Dec 17 12:37:08.798792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 32/73] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:08.916748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:08.924442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-631eb787-d633-43bb-be0c-0ef82379d101 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.148604 Dec 17 12:37:08.925028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 42/74] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:08 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:09.355120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:09.355841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:09.362059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.362567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:09.363397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.363934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:09.817656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:09.818297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:09.824351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.824866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:09.825888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.826543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:09.908777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:09.919414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:09.921859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:09.923190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c66da84f-a71c-46c8-b4b1-7b21830fa857 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1334 microversion: 2.20 time: 0.110825 Dec 17 12:37:09.924311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 43/75] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:09.931798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:09.945262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:09.946133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:09.947881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8eb04560-dd2d-44f7-9e39-249b70039dc7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.596356 Dec 17 12:37:09.948633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 33/76] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:09 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:09.952020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.952637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:09.953785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:09.954356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:10.177693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:10.184959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f67e8b74-f819-40a8-bee1-bca0099d4d43 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.243982 Dec 17 12:37:10.185571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 44/77] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:09 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:10.941827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:10.943178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:10.950594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:10.951418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:10.953479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:10.954165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:10.966083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:10.966763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:10.977829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:10.978654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:10.987062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:10.987825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:11.136288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:11.153572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:11.156068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:11.158592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-70d353c1-2d8e-43d3-9b28-f4c28ceb841e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1340 microversion: 2.20 time: 0.220595 Dec 17 12:37:11.159908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 34/78] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1340 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:11.205409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:11.206318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:11.213222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:11.213989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:11.214943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:11.215724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:11.240283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:11.255786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d7afd70a-f859-40af-8416-ebe858bcfaee tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.295364 Dec 17 12:37:11.265814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 45/79] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:10 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:11.576817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:11.585548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-434290ed-029f-4f18-82c1-4539b1ab11c8 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.387129 Dec 17 12:37:11.588972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 35/80] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:11 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:12.178032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:12.179276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:12.185433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.185885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.186942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.187371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.271869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:12.273297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:12.279416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.279851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.280635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.281075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.504679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:12.514372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:12.523435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:12.526506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2d777a07-90f2-4271-81e8-d0b4cbafed0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.352124 Dec 17 12:37:12.528193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 46/81] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:12.565448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:12.581313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1befd72d-bf45-446f-927a-5ddd1f5bd5a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.313034 Dec 17 12:37:12.582440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 36/82] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:12 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:12.615720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:12.616306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:12.637060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.638913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.642403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.642986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.663180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-d3468002-487a-43b0-830a-a223b7e7588e req-66db81c2-2894-41cc-b40b-d5bff6c7f3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:12.666356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:37:12.666356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:37:12.679341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-d3468002-487a-43b0-830a-a223b7e7588e req-66db81c2-2894-41cc-b40b-d5bff6c7f3c4 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.679928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-d3468002-487a-43b0-830a-a223b7e7588e req-66db81c2-2894-41cc-b40b-d5bff6c7f3c4 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.709480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-d3468002-487a-43b0-830a-a223b7e7588e req-66db81c2-2894-41cc-b40b-d5bff6c7f3c4 service nova] Creating event network-changed:2bde72e9-a3e5-4681-8047-cba579d4e1cb for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 on hv-cinder-80152 Dec 17 12:37:12.711551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-d3468002-487a-43b0-830a-a223b7e7588e req-66db81c2-2894-41cc-b40b-d5bff6c7f3c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 17 12:37:12.712897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.715162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.716184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:12.718295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:12.744048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.compute.rpcapi [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 17 12:37:12.745091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] Releasing lock "compute-rpcapi-router" {{(pid=127717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 17 12:37:12.795654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c84aa9ea-806c-40f6-b8e2-760fd76fd152 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256053 Dec 17 12:37:12.796798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 47/83] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:12.849363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:12.861434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-50d5f479-48ab-4e6f-af9b-44c0aa4ed56c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.255862 Dec 17 12:37:12.863592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 37/84] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:12 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:13.546473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:13.547085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:13.554478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.555429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:13.556220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.556661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:13.598056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:13.598766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:13.604682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.605137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:13.605948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.606421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:13.739290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:13.746673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99e703c1-c61d-438b-9044-cfe5ab3e8af9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.152387 Dec 17 12:37:13.747236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 38/85] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:13 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:13.768583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:13.777440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:13.778932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:13.780049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4f17ab71-ca92-46e2-9de8-e7d05601be17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.238308 Dec 17 12:37:13.780942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 48/86] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:13.880510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:13.881396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:13.887531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.888056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:13.889060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:13.889600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:14.030577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:14.038622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e8012aa1-a419-4d00-88bc-1bd89bd7249c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.162548 Dec 17 12:37:14.039704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 39/87] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:13 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:14.766344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:14.766913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:14.773033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:14.773521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:14.774307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:14.774748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:14.798207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:14.802732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:14.811909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:14.812407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:14.813404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:14.814008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:14.919205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:14.927357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d394a2f0-4268-4133-b4f2-bb60db8b0837 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.165089 Dec 17 12:37:14.936994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 49/88] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:14 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:14.959392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:14.967641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:14.969206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:14.970438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1b77efb5-cd47-449f-8365-b561a24fbd2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.176648 Dec 17 12:37:14.971088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 40/89] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:15.056883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:15.057555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:15.064068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:15.064742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:15.069059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:15.069651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:15.222570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:15.233339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-87762b2f-3093-4178-b0ce-bfb3340fe2d2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.178343 Dec 17 12:37:15.233339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 50/90] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:15 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:15.945311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:15.945881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:15.954843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:15.955358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:15.956342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:15.956948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:15.989332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:15.989974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:15.999961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:16.003848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:16.004945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:16.005597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:16.196609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:16.213265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:16.215284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:16.216694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d0a0665f-3c67-4805-adc7-4990bcd2b476 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.232192 Dec 17 12:37:16.217802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 51/91] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:16.250753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:16.255505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:16.264755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:16.273313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ae56eb2-39cb-4a60-9228-bcdf620ef919 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.333094 Dec 17 12:37:16.273990 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 41/92] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:15 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:16.277404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:16.278017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:16.279387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:16.280372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:16.488831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:16.504199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e8820fdd-7fcc-4a8b-83e7-1c2d9a60c0c4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.258693 Dec 17 12:37:16.505196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 52/93] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:16 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:17.235094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:17.235787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:17.242105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.242564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.243352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.244088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.291665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:17.292969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:17.300702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.305302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.306338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.306927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.471095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:17.480876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:17.483141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:17.484281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-91369eb5-f872-48c3-bd6d-4dbd54bcd629 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.253361 Dec 17 12:37:17.484987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 42/94] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:17.526788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:17.527649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:17.539459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.540812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.542137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:17.542923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:17.611683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:17.634754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cfcc7c19-e07d-474a-b960-bb929a4cb8ef tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.346555 Dec 17 12:37:17.636545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 53/95] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:17 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:17.853157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:17.884230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b25d6f03-571e-4de6-b16f-9be778d5dd51 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.365923 Dec 17 12:37:17.884873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 43/96] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:17 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:18.502399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:18.503029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:18.511598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.512275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:18.513341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.514143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:18.653074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:18.654251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:18.662188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.662758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:18.663644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.664166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:18.716601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:18.725135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:18.726644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:18.727747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dad9d8a0-9f3b-4b58-b962-30bb2472098d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.229215 Dec 17 12:37:18.728314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 54/97] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:18 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:18.830730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:18.838210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ad87301-9d50-4531-8469-ce6060d3c379 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.190046 Dec 17 12:37:18.838906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 44/98] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:18 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:18.900793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:18.901455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:18.907362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.907963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:18.908985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:18.909597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:19.063547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:19.071628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4b44aba-85f5-4aad-9c31-cd18b3623fab tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.174450 Dec 17 12:37:19.072498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 55/99] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:18 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:19.746100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:19.747519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:19.760216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:19.761192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:19.764925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:19.765803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:19.855698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:19.856302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:19.871549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:19.876974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:19.878233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:19.880710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:20.034569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:20.042926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:20.045862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:20.047938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1d5d0f67-d8f2-4e3e-bbdb-6e9bc6951af1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.305976 Dec 17 12:37:20.058981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 45/100] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:20.089356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:20.090031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:20.097958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:20.107262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b6a61cf1-3de5-4596-bcd3-aa1b024d3bdd tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.256045 Dec 17 12:37:20.107821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 56/101] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:19 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:20.109694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:20.110139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:20.111126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:20.111721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:20.262667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:20.270325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce719868-d5b1-49c7-9172-5640857d3906 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.184942 Dec 17 12:37:20.279524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 46/102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:20 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:20.384188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-7ccf7f2c-d437-4a4e-8d19-abba5c8e6af6 req-8cc3d2f0-18b9-4e17-bcf8-037a93be28bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bccb27-15b6-4808-a28e-5dce8b7485d6", "name": "network-vif-plugged", "status": "completed", "tag": "5ad96499-86e8-43cd-b369-21035e25bf77"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:20.386106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:37:20.386106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:37:20.393053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7ccf7f2c-d437-4a4e-8d19-abba5c8e6af6 req-8cc3d2f0-18b9-4e17-bcf8-037a93be28bd service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:20.393603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7ccf7f2c-d437-4a4e-8d19-abba5c8e6af6 req-8cc3d2f0-18b9-4e17-bcf8-037a93be28bd service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:20.408813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-7ccf7f2c-d437-4a4e-8d19-abba5c8e6af6 req-8cc3d2f0-18b9-4e17-bcf8-037a93be28bd service nova] Creating event network-vif-plugged:5ad96499-86e8-43cd-b369-21035e25bf77 for instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 on hv-cinder-80152 Dec 17 12:37:20.413953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-7ccf7f2c-d437-4a4e-8d19-abba5c8e6af6 req-8cc3d2f0-18b9-4e17-bcf8-037a93be28bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260144 Dec 17 12:37:20.414631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 57/103] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:21.067037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:21.067646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:21.075394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.075967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.078126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.078782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.125441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:21.126243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:21.136674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.137116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.137932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.138360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.252676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:21.279782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:21.281643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:21.282882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6a77c37-af95-4e6c-af2a-4f265c0f1526 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.221370 Dec 17 12:37:21.283448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 47/104] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:21.292148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:21.299364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:21.309668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.310117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.310915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:21.314305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:21.343698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:21.354651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-140072bd-a244-4964-b036-d9b28bce9f89 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.234093 Dec 17 12:37:21.355705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 58/105] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:21 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:21.512430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:21.520071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0cd1aa10-17c8-47d5-8905-d5ad38d86dcb tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.235591 Dec 17 12:37:21.520868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 48/106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:21 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:22.301335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:22.302596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:22.310451 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.310972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.311670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.312269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.371716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:22.372378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:22.378997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.379550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.380524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.381122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.493828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:22.502873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:22.505256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:22.506587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d278969-3af9-4a80-890e-d8bb3e9bc620 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.210174 Dec 17 12:37:22.507295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 59/107] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:22.523644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "name": "network-vif-plugged", "status": "completed", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}, {"server_uuid": "06c28864-8d42-45d6-90c4-e7cb6c3e3c24", "name": "network-vif-plugged", "status": "completed", "tag": "37a0972d-1242-406b-b7c5-f0f02924f739"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:22.526919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:37:22.526919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:37:22.549123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.549890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.579623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] Creating event network-vif-plugged:2bde72e9-a3e5-4681-8047-cba579d4e1cb for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 on hv-cinder-80152 Dec 17 12:37:22.580381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] Creating event network-vif-plugged:37a0972d-1242-406b-b7c5-f0f02924f739 for instance 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 on hv-cinder-80152 Dec 17 12:37:22.592805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-17c8a54b-9fa5-4038-93ab-ca2102bd5f35 req-1ba83669-e1d2-4829-a9f7-919668372ac7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083853 Dec 17 12:37:22.594764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 60/108] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:37:22 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:22.602964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:22.603837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:22.616136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.617331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.620314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:22.621138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:22.672496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:22.686725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dd5a91f1-e5a7-498f-b941-af21dddcf22d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.317147 Dec 17 12:37:22.689416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 49/109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:22 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:23.094406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:23.114123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-52bd0221-5f31-4f81-941d-06146b85d612 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1315 microversion: 2.1 time: 0.516308 Dec 17 12:37:23.115493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 61/110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:22 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:23.530125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:23.531915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:23.541546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:23.542299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:23.543583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:23.544487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:23.707776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:23.708993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:23.709744 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:23.719078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:23.720757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:23.722161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:23.722786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:23.725513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:23.728128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:23.729665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d6f16aff-6b0a-4fc3-9534-f10566e87827 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.206215 Dec 17 12:37:23.730237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 50/111] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:37:23.896926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:23.905557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-64e1039b-48a3-427e-93d1-5dcb7b17acd4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.204017 Dec 17 12:37:23.909977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 62/112] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:23 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:24.132336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:24.133256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:24.139304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.139754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.140555 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.140960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.298628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:24.307042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b771b937-3337-4af0-9cee-44fdfce6c85d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1503 microversion: 2.1 time: 0.179146 Dec 17 12:37:24.308103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 51/113] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:24 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:24.746931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:24.747951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:24.755090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.755795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.756869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.757583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.926336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:24.927795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:24.938663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.940514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.941590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:24.942498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:24.970247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:24.981820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:24.983389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:24.984567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e6102bba-593f-4c6b-a4d1-ad88fb70e56a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.241372 Dec 17 12:37:24.985245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 63/114] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:25.085652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:25.096287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe2abb66-271f-453e-8b48-fc12fcbe923c tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.173722 Dec 17 12:37:25.097019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 52/115] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:24 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:26.002304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:26.002874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:26.010286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:26.010735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:26.011522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:26.011952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:26.112293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:26.112890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:26.119059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:26.119506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:26.120290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:26.120722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:26.137515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:26.146004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:26.147946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:26.149270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4f2aff6d-7e08-4021-8d88-477d15781831 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.151102 Dec 17 12:37:26.149936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 64/116] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:26.256790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:26.264732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5050c49d-5469-4e44-9208-b9d63578e9f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.156064 Dec 17 12:37:26.273745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 53/117] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:26 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:27.166904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:27.167477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:27.173531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:27.173973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:27.174740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:27.175164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:27.282154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:27.282908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:27.289268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:27.289756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:27.290561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:27.290980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:27.305782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:27.318497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:27.320387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:27.323888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-748a1662-134b-422d-b838-5c4875171b4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.160692 Dec 17 12:37:27.334532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 65/118] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:27 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:27.427788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:27.435208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8bd0e2f9-5a5c-454c-bcac-57c4602abdb3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.156775 Dec 17 12:37:27.435786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 54/119] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:27 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:28.341772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:28.342390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:28.348423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.348881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:28.349707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.350145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:28.453569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:28.454302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:28.460495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.461188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:28.462015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.462445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:28.518795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:28.529931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:28.532626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:28.534413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b1c5c903-3593-4226-bb63-9e85453a7713 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.196370 Dec 17 12:37:28.535499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 66/120] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:28.610189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:28.617535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e6146e0-1f9b-458c-b2d4-c60fd9855aa2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1316 microversion: 2.1 time: 0.168934 Dec 17 12:37:28.618165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 55/121] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:28 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:28.893566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c04de98d-7233-46ce-bcee-0a441946c6e8"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:28.894801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:28.900840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.901312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:28.902071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:28.902637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:29.397066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c0ad810c-273d-4d91-a22a-5d585805b296 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "POST /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506936 Dec 17 12:37:29.398127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 67/122] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:37:28 2021] POST /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:29.552046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:29.553851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:29.563926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:29.564506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:29.566221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:29.568304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:29.638291 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:29.642411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:29.654616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:29.655649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:29.656641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:29.658109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:29.757035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:29.767005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:29.769165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:29.770959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30353204-c56b-45cd-8058-81dfe902b375 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1408 microversion: 2.20 time: 0.222596 Dec 17 12:37:29.781546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 56/123] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:29.838339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:29.845992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-265b7643-b731-42a9-80b3-5f8cbdbf4302 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1506 microversion: 2.1 time: 0.212900 Dec 17 12:37:29.846561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 68/124] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:29 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:37:30.787835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:30.788441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:30.794424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:30.794936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:30.795819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:30.796242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:30.937801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:30.949458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:30.949458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:30.949458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d468511e-c29e-4e33-9f9b-b7e0b83b6ede tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1600 microversion: 2.20 time: 0.165198 Dec 17 12:37:30.950009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 57/125] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:37:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:37:30.967217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:30.967682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:30.974687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:30.975127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:30.975904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:30.976333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:31.080078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e5a6462-cbf1-4f01-9707-8eba7a7ab023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116548 Dec 17 12:37:31.081137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 69/126] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Dec 17 12:37:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 12:37:32.489606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:32.490596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:32.492995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-935bf23b-5b2b-47f3-b203-a32635b149c1 req-85e2b2d5-e035-4c66-8ec2-5a405c5617a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:32.495343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:37:32.495343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:37:32.501581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:32.502303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:32.503254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:32.503829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:32.505438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-935bf23b-5b2b-47f3-b203-a32635b149c1 req-85e2b2d5-e035-4c66-8ec2-5a405c5617a1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:32.506177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-935bf23b-5b2b-47f3-b203-a32635b149c1 req-85e2b2d5-e035-4c66-8ec2-5a405c5617a1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:32.519058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-935bf23b-5b2b-47f3-b203-a32635b149c1 req-85e2b2d5-e035-4c66-8ec2-5a405c5617a1 service nova] Creating event network-changed:2bde72e9-a3e5-4681-8047-cba579d4e1cb for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 on hv-cinder-80152 Dec 17 12:37:32.524525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-935bf23b-5b2b-47f3-b203-a32635b149c1 req-85e2b2d5-e035-4c66-8ec2-5a405c5617a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Dec 17 12:37:32.525195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 70/127] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:37:34.589674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-34b5b35a-561c-4824-9e0c-c6b49fb85eed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 14 microversion: 2.20 time: 2.103291 Dec 17 12:37:34.590440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 58/128] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:32 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 14 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:35.601209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:35.602252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:35.608940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:35.609393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:35.610198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:35.610623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:35.683365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4e6a63b2-4c35-467d-8095-0fa557be8bac tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 14 microversion: 2.20 time: 0.085592 Dec 17 12:37:35.684415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 71/129] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:35 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:36.699478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:36.700932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:36.714725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:36.715370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:36.716493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:36.717122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:39.606483 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5fe42721-7a17-4887-b44b-2a339e2e5253 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 14 microversion: 2.20 time: 2.912269 Dec 17 12:37:39.607461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 59/130] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:36 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 14 bytes in 2915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:40.621804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:40.622891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:40.631744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:40.632190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:40.632964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:40.633432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:40.695521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3779f8c5-ce07-4912-91cd-55144b64f26a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 14 microversion: 2.20 time: 0.078844 Dec 17 12:37:40.696473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 72/131] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:40 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:41.709117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:41.710338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:41.718598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:41.719134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:41.720028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:41.720530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:41.791006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ebec54ee-24ba-4970-a4a0-648b71d4c7b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 14 microversion: 2.20 time: 0.085962 Dec 17 12:37:41.794180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 60/132] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:41 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:42.311082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd5810b-c2b2-4e61-a439-c666de55e9d6"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:42.312423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:42.319559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:42.319998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:42.320777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:42.321207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:42.802546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:42.803976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:42.811040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:42.811583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:42.812570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:42.813206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:46.871840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-827aeba1-c007-4546-b663-05aac4974e0f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 18208 microversion: 2.20 time: 4.073309 Dec 17 12:37:46.872568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 61/133] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:42 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 18208 bytes in 4075 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:47.003197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f246c7c6-2015-4e70-8ee9-9ace9afbe445 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.696101 Dec 17 12:37:47.004089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 73/134] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:37:42 2021] POST /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments => generated 194 bytes in 4698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:37:47.884767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:47.887044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:47.893656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:47.894102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:47.894885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:47.895313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:47.977172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f595311-7dd6-433b-ba74-ccdfa887c117 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 18208 microversion: 2.20 time: 0.096550 Dec 17 12:37:47.977949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 62/135] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:47 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 18208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:48.991047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:48.993411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:49.002859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:49.002859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:49.002859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:49.002859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:52.767187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c234abd6-1d40-4468-99d7-81f2ccb1ffef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 25249 microversion: 2.20 time: 3.780616 Dec 17 12:37:52.767842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 74/136] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:48 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 25249 bytes in 3783 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:53.779830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:53.780863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:53.788218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:53.788669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:53.789484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:53.789917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:53.870600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-826fc099-fa1a-424c-9c0b-c622bc9a8a17 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 26245 microversion: 2.20 time: 0.094872 Dec 17 12:37:53.871257 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 63/137] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:53 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 26245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:54.883534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:54.884917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:54.894210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:54.894660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:54.895440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:54.895995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:54.975664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c9ee3a29-9205-41ae-a247-320777bcad2a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 26954 microversion: 2.20 time: 0.096487 Dec 17 12:37:54.976291 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 75/138] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:54 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 26954 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:55.298395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1015854539", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:55.352965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] validate_networks() for None {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:37:55.688116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:37:55.688695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:37:55.689328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:37:55.689734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:37:55.690133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:37:55.698768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:55.699473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:55.700247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:55.700673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:55.719463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Getting quotas for project fda7c148765e40c1aa84e754cfa5fc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:37:55.723634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Getting quotas for user c337e2f1530a475885a919f02f52c436 and project fda7c148765e40c1aa84e754cfa5fc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:37:55.735696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:37:55.738162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:37:55.794029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7e6f063-db87-4403-a6ec-55d8a0eb0108 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499608 Dec 17 12:37:55.796082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 64/139] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:37:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:37:55.809172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4185ee0e-624f-4103-8244-68f2df52c4d2 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:55.810086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4185ee0e-624f-4103-8244-68f2df52c4d2 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:55.876307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4185ee0e-624f-4103-8244-68f2df52c4d2 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:55.886233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4185ee0e-624f-4103-8244-68f2df52c4d2 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1215 microversion: 2.1 time: 0.083347 Dec 17 12:37:55.887149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 76/140] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:55 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:55.991270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:55.993140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:56.003468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:56.004826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:56.005845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:56.006425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:56.145587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b5dea88f-619e-47c7-b547-4464bcf56898 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 27604 microversion: 2.20 time: 0.159913 Dec 17 12:37:56.146647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 65/141] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:55 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 27604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:37:56.902481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:56.903973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:56.914927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:56.918461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:56.921296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:56.922499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:57.000130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:57.007758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7165cd4-4ffd-44e2-a3c7-b3670535cb86 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1267 microversion: 2.1 time: 0.109212 Dec 17 12:37:57.008580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 77/142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:56 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:57.161351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:37:57.163393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:57.184420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:57.185205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:57.186247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:57.186897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:58.029508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:58.030824 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:58.039821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:58.043103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:58.044543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:58.045348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:58.114862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:58.122736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-904cdcc7-4b6d-477b-ad83-93c920119f4f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1273 microversion: 2.1 time: 0.100003 Dec 17 12:37:58.123310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 78/143] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:58 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:37:59.139584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:37:59.140270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:37:59.146554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:59.146994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:59.147761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:37:59.148180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:37:59.215513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:37:59.223524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44958521-033b-4e6c-a5ed-219a87c88ad9 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1273 microversion: 2.1 time: 0.087656 Dec 17 12:37:59.224104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 79/144] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:37:59 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:00.239955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:00.240880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:00.247609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:00.248055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:00.248874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:00.249315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:00.317940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:00.329120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26eb66e7-06ae-41ce-ae65-3a24df7f11b3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1273 microversion: 2.1 time: 0.092667 Dec 17 12:38:00.329901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 80/145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:00 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:00.362699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-136e8ba6-ab99-4d1d-9882-cfc9d732ed4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 27911 microversion: 2.20 time: 3.206981 Dec 17 12:38:00.363864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 66/146] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:37:57 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 27911 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:01.350168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:01.350972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:01.359302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:01.359974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:01.360738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:01.361163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:01.375444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:01.376473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:01.384288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:01.384740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:01.385610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:01.385992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:01.495726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:01.503100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-85c0ba16-5b3b-4dd2-a717-613b0955e0ec tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.157927 Dec 17 12:38:01.503663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 81/147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:01 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:02.036205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0f3cb10f-fc7b-4215-9f79-24ed38c1bd09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 27911 microversion: 2.20 time: 0.664773 Dec 17 12:38:02.037734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 67/148] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:01 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 27911 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:02.520428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:02.521860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:02.531300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:02.532074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:02.533652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:02.534216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:02.632536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-b33e16d6-0289-4214-af3f-c7911530c7dd req-8ceb4160-9449-4a3d-81c7-7f78b54d2754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7393dbe-93cc-485c-93f0-7a5fa54e61b6", "tag": "af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:02.635305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:02.635305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:38:02.661085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b33e16d6-0289-4214-af3f-c7911530c7dd req-8ceb4160-9449-4a3d-81c7-7f78b54d2754 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:02.664104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b33e16d6-0289-4214-af3f-c7911530c7dd req-8ceb4160-9449-4a3d-81c7-7f78b54d2754 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:02.689543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-b33e16d6-0289-4214-af3f-c7911530c7dd req-8ceb4160-9449-4a3d-81c7-7f78b54d2754 service nova] Creating event network-changed:af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b for instance e7393dbe-93cc-485c-93f0-7a5fa54e61b6 on hv-cinder-80152 Dec 17 12:38:02.697762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-b33e16d6-0289-4214-af3f-c7911530c7dd req-8ceb4160-9449-4a3d-81c7-7f78b54d2754 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069923 Dec 17 12:38:02.698540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 68/149] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:02.736425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:02.743985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-323212d5-cd1a-4d4b-af58-1fbd47ac7ada tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.227829 Dec 17 12:38:02.744563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 82/150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:02 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:03.048112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:03.049326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:03.056431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:03.056892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:03.057760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:03.058216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:03.121747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30a5082e-70c8-4ba6-9354-b2314ad68926 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 27911 microversion: 2.20 time: 0.077669 Dec 17 12:38:03.122406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 69/151] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:03 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 27911 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:03.759656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:03.760261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:03.766781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:03.767257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:03.768025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:03.768456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:03.918126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:03.928297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ce744005-6ba7-4910-8a3e-bcfc6982c4c4 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.172246 Dec 17 12:38:03.928873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 83/152] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:03 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:04.134241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:04.135368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:04.142932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:04.143461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:04.144323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:04.144824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:04.949057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:04.949951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:04.958732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:04.959180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:04.959957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:04.960364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:05.106312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:05.114247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8755f97-b1c8-47b2-90e8-98a02880b445 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.171550 Dec 17 12:38:05.114829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 84/153] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:04 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:06.134682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:06.135651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:06.146347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:06.147088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:06.148405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:06.149124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:06.284196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:06.291956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2af19c92-65bd-420d-900e-91ee03715781 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.163512 Dec 17 12:38:06.292520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 85/154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:06 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:07.308474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:07.309085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:07.316330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:07.316767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:07.317578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:07.318007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:07.460620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:07.468317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-38c457c8-345d-4b1c-b249-ffe2656b02d8 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.163632 Dec 17 12:38:07.468920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 86/155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:07 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:08.489818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:08.490817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:08.501230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:08.502027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:08.503312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:08.503740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:08.645709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:08.653707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-908f574f-9b77-460a-ac56-be827a66366f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.170096 Dec 17 12:38:08.654279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 87/156] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:08 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:09.283800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f61e95a1-0784-495b-b881-64ba055fee5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 27977 microversion: 2.20 time: 5.152894 Dec 17 12:38:09.285110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 70/157] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:04 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 27977 bytes in 5156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:09.676775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:09.677800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:09.688520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:09.689267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:09.690751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:09.691190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:09.832046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:09.839421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92a68108-b49b-417e-a08d-2d115697a6a3 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.168894 Dec 17 12:38:09.839986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 88/158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:09 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:10.188366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:10.188941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:10.196328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.196771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.197587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.198016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.225084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:38:10.296271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:10.297320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:10.303565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.304021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.304818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.305246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.321373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4339af4-dc41-4337-a59f-aa35acddf9d0 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "DELETE /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 204 len: 0 microversion: 2.1 time: 0.136450 Dec 17 12:38:10.322279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 71/159] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:38:10 2021] DELETE /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:38:10.330767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:10.331497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:10.338955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.339454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.340177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.340603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.423821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b51102ce-91fe-4a45-a315-86ed86f3088e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28089 microversion: 2.20 time: 0.130863 Dec 17 12:38:10.424645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 89/160] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:10 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28089 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:10.473231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:10.481250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16be60ce-e4b5-4da8-a04c-718e22212d6d tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.154730 Dec 17 12:38:10.481846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 72/161] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:10 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:10.859631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:10.860410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:10.868180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.868628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:10.869437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:10.869869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:11.003279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:11.011228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-56fd9b9a-66c9-4f5e-ba95-bc379d7fb16d tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.158059 Dec 17 12:38:11.011805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 90/162] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:10 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:11.440074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:11.441701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:11.449058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:11.449559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:11.450381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:11.450814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:11.498273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:11.498712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:11.505115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:11.505604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:11.506405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:11.507013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:11.638971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1d587a38-5b3b-49fd-a3d9-168dd9321acb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28156 microversion: 2.20 time: 0.204934 Dec 17 12:38:11.640538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 73/163] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:11 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28156 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:11.640773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:11.649266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c79b7334-8882-4b12-9d70-1a76c7ed4960 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.154836 Dec 17 12:38:11.649844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 91/164] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:11 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:12.028410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:12.029104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:12.036215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.036660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.037475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.037915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.171793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:12.179212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66831bec-2bce-4343-be90-10f67f419241 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.154870 Dec 17 12:38:12.179792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 74/165] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:12 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:12.655962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:12.657051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:12.664573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.665019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.665786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:12.666232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.666232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.666396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:12.673048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.673530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.674302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:12.674704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:12.804243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:12.814982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-df8c03b1-c0c7-4d10-942b-74a44f04f1ae tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.152779 Dec 17 12:38:12.815761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 75/166] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:12 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:13.195614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:13.196239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:13.203165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:13.203603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:13.204366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:13.204800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:13.348406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:13.356152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6041226d-153d-4169-b129-88e527af0a14 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.164241 Dec 17 12:38:13.356718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 76/167] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:13 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:13.835493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:13.836072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:13.842867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:13.843304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:13.844062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:13.844481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:13.977400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:13.985629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cdf3439e-1672-4f66-93d6-8c0218f15773 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.155593 Dec 17 12:38:13.986200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 77/168] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:13 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:14.375657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:14.376701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:14.384697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:14.385135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:14.385948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:14.386374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:14.518272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:14.526005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-185386d8-c550-41d5-bc5e-a2df9a5fb47e tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.156616 Dec 17 12:38:14.526547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 78/169] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:14 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:15.003146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:15.003753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:15.010489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:15.010942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:15.011714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:15.012142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:15.141136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:15.153507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fdfbe720-baf8-403a-b907-69221b88e6cc tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.153734 Dec 17 12:38:15.154360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 79/170] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:14 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:15.545888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:15.546683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:15.555082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:15.555527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:15.556301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:15.556729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:15.688058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:15.695433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9e976c3f-a2f9-444d-a388-a78e70185022 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.155455 Dec 17 12:38:15.695972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 80/171] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:15 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:16.176911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:16.177977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:16.185510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:16.186000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:16.186844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:16.187316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:16.316871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:16.325617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f7e34f6e-9722-472d-b5e9-d8fe3d1bcd22 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.154751 Dec 17 12:38:16.326196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 81/172] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:16 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:16.714791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:16.715598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:16.723914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:16.724509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:16.725597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:16.726177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:16.866220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:16.873827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-717ffb98-d4ed-42ac-b2ff-d3be8d215c7a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.164153 Dec 17 12:38:16.879473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 82/173] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:16 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:16.891943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c50851b7-55c1-440b-8ba5-d7cb28c15967 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 4.242014 Dec 17 12:38:16.895890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 92/174] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:12 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 4244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:17.342805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:17.343378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:17.349825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.350331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.351113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.351541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.583867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:17.594160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-36ab14e4-7d0f-42d1-bc2f-5843d45812ff tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1555 microversion: 2.1 time: 0.254941 Dec 17 12:38:17.594836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 83/175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:17 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:17.749821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-1334ce1b-a48a-435a-9d7a-4bbc9dda60fb req-3ca78505-784f-4696-a2b7-bd1436a38276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bccb27-15b6-4808-a28e-5dce8b7485d6", "name": "network-vif-deleted", "tag": "5ad96499-86e8-43cd-b369-21035e25bf77"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:17.751335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:17.751335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:38:17.760923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-1334ce1b-a48a-435a-9d7a-4bbc9dda60fb req-3ca78505-784f-4696-a2b7-bd1436a38276 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.761388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-1334ce1b-a48a-435a-9d7a-4bbc9dda60fb req-3ca78505-784f-4696-a2b7-bd1436a38276 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.774467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-1334ce1b-a48a-435a-9d7a-4bbc9dda60fb req-3ca78505-784f-4696-a2b7-bd1436a38276 service nova] Creating event network-vif-deleted:5ad96499-86e8-43cd-b369-21035e25bf77 for instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 on hv-cinder-80152 Dec 17 12:38:17.780656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-1334ce1b-a48a-435a-9d7a-4bbc9dda60fb req-3ca78505-784f-4696-a2b7-bd1436a38276 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Dec 17 12:38:17.781855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 93/176] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:17.890736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:17.891319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:17.897364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.897959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.898886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.899312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.904099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:17.905104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:17.911730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.912184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.913061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:17.913528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:17.980788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e3f15fca-8003-4027-89ff-c9efa2061237 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.080195 Dec 17 12:38:17.981311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 94/177] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:17 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:18.030529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:18.038001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c21a54c2-299e-47f4-bcb4-c0c46d1efe5f tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.150954 Dec 17 12:38:18.038544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 84/178] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:17 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:18.611787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:18.612483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:18.619729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:18.620194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:18.620975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:18.621441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:18.684945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:18.693457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3ccdf8ab-b174-452f-8c6b-f70ba092538f tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.085787 Dec 17 12:38:18.694060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 95/179] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:18 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:18.995530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:18.996470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:19.002606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.003066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.003839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.004271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.055262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:19.055832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:19.062553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.063002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.063784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.064214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.203195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:19.212667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fe1218e7-d5ca-46b5-b9a1-22419c12c1ba tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.161237 Dec 17 12:38:19.213304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 96/180] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:19 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:19.713667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:19.714509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:19.723107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.723715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.724742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:19.725337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:19.789752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:19.797661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba9bdf03-487e-402a-bf71-87230ffda47c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.089424 Dec 17 12:38:19.798243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 97/181] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:19 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:20.233970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:20.235025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:20.246172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:20.246918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:20.248199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:20.248920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:20.389720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:20.400350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-95b714db-aa65-4cd8-aeb2-0d9bfe6f5abc tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.172756 Dec 17 12:38:20.400916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 98/182] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:20 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:20.818715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:20.819617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:20.826815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:20.826815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:20.827604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:20.828024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:20.894936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:20.903263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20ee289e-ad46-445b-8067-2fd330709e46 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.090811 Dec 17 12:38:20.903837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 99/183] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:20 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:21.417592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:21.418237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:21.425213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:21.425659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:21.426439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:21.426871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:21.556069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:21.563695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a7448a6-0461-47f3-addf-95a3b6e74c7b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.150286 Dec 17 12:38:21.564272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 100/184] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:21 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:21.924028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:21.925021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:21.935466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:21.936199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:21.937510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:21.938347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:22.000140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:22.008165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c99d7ae2-bb0c-474f-b81e-be45f8e31105 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.090353 Dec 17 12:38:22.008728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 101/185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:21 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:22.177692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30a8b839-0edd-4091-9526-8fc00decb3c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 3.185994 Dec 17 12:38:22.178763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 85/186] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:18 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 3189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:22.584219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:22.585847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:22.595818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:22.596553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:22.597861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:22.598573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:22.732702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:22.739980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-25fcfa36-0898-47f2-9e7c-0caf4881c685 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.161949 Dec 17 12:38:22.740554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 102/187] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:22 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:23.027063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:23.027978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:23.037342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.037965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.038990 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.039533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.102736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:23.111088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7fdc978-783e-46dd-a050-7326e893a07c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.089918 Dec 17 12:38:23.111663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 86/188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:23 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:23.193355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:23.194391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:23.200403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.200852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.202026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.202457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.313007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a3f16421-f68f-4932-977b-0d94db06fda8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.124349 Dec 17 12:38:23.313702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 103/189] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:23 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:23.759799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:23.760655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:23.770549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.771279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.772477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:23.773036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:23.923353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:23.934667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b786fb37-8fd8-482d-8dba-b75859c13b45 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.180303 Dec 17 12:38:23.935438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 87/190] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:23 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:24.134477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:24.135172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:24.142077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.142529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.143308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.143740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.235521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a94a1ea58843baba3000670c6b5a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec5c5d371d64df6911f3561ce364e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:24.244546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d6821fa7-39ed-4016-9f23-658929d80bd2 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 200 len: 1346 microversion: 2.1 time: 0.120229 Dec 17 12:38:24.256720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 104/191] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:24 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 1346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:24.330753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:24.331986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:24.338581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.340259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.341743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.342443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.389575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-4bc5d0cc-0ed0-424e-9d1e-9b4c199b82d9 req-2ebe4151-6c9a-469f-806c-57206c096206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7393dbe-93cc-485c-93f0-7a5fa54e61b6", "name": "network-vif-plugged", "status": "completed", "tag": "af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:24.392152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:24.392152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:38:24.400555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-4bc5d0cc-0ed0-424e-9d1e-9b4c199b82d9 req-2ebe4151-6c9a-469f-806c-57206c096206 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.401252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-4bc5d0cc-0ed0-424e-9d1e-9b4c199b82d9 req-2ebe4151-6c9a-469f-806c-57206c096206 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.415775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ac0565c-45d0-41ed-8aa1-3d868daf3557 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.092310 Dec 17 12:38:24.416909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 88/192] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:24 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:24.422641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-4bc5d0cc-0ed0-424e-9d1e-9b4c199b82d9 req-2ebe4151-6c9a-469f-806c-57206c096206 service nova] Creating event network-vif-plugged:af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b for instance e7393dbe-93cc-485c-93f0-7a5fa54e61b6 on hv-cinder-80152 Dec 17 12:38:24.428612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-4bc5d0cc-0ed0-424e-9d1e-9b4c199b82d9 req-2ebe4151-6c9a-469f-806c-57206c096206 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043991 Dec 17 12:38:24.429585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 105/193] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:24.958481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:24.959254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:24.973918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.973918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:24.973918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:24.973918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.121156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:25.128768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d20d242f-b29b-4d3e-a724-a50986e2f55b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.177628 Dec 17 12:38:25.129461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 89/194] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:24 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:25.263792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:25.264483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:25.270743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.271021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.272070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.272479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.285823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] HTTP exception thrown: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. Dec 17 12:38:25.286411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Returning 404 to user: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:25.287201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d205297d-4747-499f-b4f2-acdcd92cb83c tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 404 len: 111 microversion: 2.1 time: 0.027959 Dec 17 12:38:25.287979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 106/195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:25 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:38:25.403405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:25.404316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:25.411360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.411825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.412678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.413103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.425953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] HTTP exception thrown: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. Dec 17 12:38:25.426540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Returning 404 to user: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:25.427357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3e8f856-163d-48f8-bbda-dd24323c83d4 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027796 Dec 17 12:38:25.428185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:25.428301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 90/196] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:38:25 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:38:25.429053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:25.437342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.437812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.438594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:25.439153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:25.608037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-95233738-62eb-4b75-9cb4-8a49357253b8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.183967 Dec 17 12:38:25.612354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 107/197] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:25 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:26.145803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:26.146529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:26.162671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.162671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.162671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.162671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.319229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:26.328336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a15814d-9781-4d00-8ec2-457e2e644256 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1315 microversion: 2.1 time: 0.186954 Dec 17 12:38:26.329893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 91/198] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:26 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:26.620349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:26.621397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:26.622091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:26.622828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:26.629858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.630344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.631548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.631735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.632347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.632725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.634098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.634557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.650185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] HTTP exception thrown: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. Dec 17 12:38:26.650791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Returning 404 to user: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:26.651814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-91b9dae6-90bc-418e-a2a9-52d647e032db tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "DELETE /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 404 len: 111 microversion: 2.1 time: 0.035103 Dec 17 12:38:26.652608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 92/199] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:38:26 2021] DELETE /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:38:26.661015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:26.661651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] [instance: 92bccb27-15b6-4808-a28e-5dce8b7485d6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:26.667931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.668487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.669316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:26.670076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:26.690367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] HTTP exception thrown: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. Dec 17 12:38:26.691738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] Returning 404 to user: Instance 92bccb27-15b6-4808-a28e-5dce8b7485d6 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:26.693062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b877bdec-774a-4137-979a-f2077fa96262 tempest-DeleteServersTestJSON-2111998598 tempest-DeleteServersTestJSON-2111998598-project] 10.222.0.45 "GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6" status: 404 len: 111 microversion: 2.1 time: 0.036068 Dec 17 12:38:26.694766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 93/200] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:26 2021] GET /compute/v2.1/servers/92bccb27-15b6-4808-a28e-5dce8b7485d6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:38:26.740261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d93b0be-64e8-450a-83f9-308fb8584313 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.123783 Dec 17 12:38:26.741019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 108/201] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:26 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:27.345462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:27.346072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:27.352165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.352606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.353399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.353821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.746616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:27.755796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30d6fbd0-832e-4053-b7d4-98d65b430f3a tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1465 microversion: 2.1 time: 0.413834 Dec 17 12:38:27.757340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 94/202] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:27 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1465 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:27.761861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:27.762989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:27.781470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.781906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.782775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.783194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.798766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:27.799252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:27.812428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.813166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.814328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.814955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.852378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:38:27.854913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e1296c22-e1ef-44eb-81fc-5f170f9c1fd7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.105161 Dec 17 12:38:27.860452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 109/203] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:27 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:27.934436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5717e963-1512-4ef6-9df2-ce0f8ad7f93b tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 204 len: 0 microversion: 2.1 time: 0.138991 Dec 17 12:38:27.935380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 95/204] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:38:27 2021] DELETE /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 17 12:38:27.944542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:27.945418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:27.956090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.956713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:27.957624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:27.958259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:28.126083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:28.133885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-60e553e3-efc4-442c-a8d7-f38e0198c5b5 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1471 microversion: 2.1 time: 0.193678 Dec 17 12:38:28.134731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 110/205] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:27 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:28.869375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:28.871335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:28.889665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:28.900303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:28.901236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:28.901724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:28.977406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8be7bc40-dff7-446b-a4ec-3235eccb9dec tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.112961 Dec 17 12:38:28.978873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 96/206] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:28 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:29.151952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:29.152563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:29.164904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:29.165406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:29.166218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:29.166641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:29.459186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:29.466956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c1002e93-4392-4ba5-88b5-b05add187853 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1471 microversion: 2.1 time: 0.318588 Dec 17 12:38:29.467545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 111/207] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:29 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:29.990939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:29.993725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:30.000591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:30.001405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:30.002426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:30.003064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:30.070786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a659ebcd-6bfa-4eb1-9feb-1dd90eb0375f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.083743 Dec 17 12:38:30.071721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 97/208] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:29 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:30.484450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:30.485135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:30.495208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:30.495645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:30.496423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:30.497496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:30.619843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-e60d9d55-db99-465d-9b00-f7754f93f882 req-d920688d-f511-420f-83f2-64b90badc9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7393dbe-93cc-485c-93f0-7a5fa54e61b6", "name": "network-vif-deleted", "tag": "af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:30.621505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:30.621505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:38:30.633131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e60d9d55-db99-465d-9b00-f7754f93f882 req-d920688d-f511-420f-83f2-64b90badc9d6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:30.636407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e60d9d55-db99-465d-9b00-f7754f93f882 req-d920688d-f511-420f-83f2-64b90badc9d6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:30.651173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c337e2f1530a475885a919f02f52c436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda7c148765e40c1aa84e754cfa5fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:30.669927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9c53e593-c83b-422f-adc4-75da6a1c60fa tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 200 len: 1429 microversion: 2.1 time: 0.189644 Dec 17 12:38:30.673436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-e60d9d55-db99-465d-9b00-f7754f93f882 req-d920688d-f511-420f-83f2-64b90badc9d6 service nova] Creating event network-vif-deleted:af8b7fa7-f51e-455f-af75-fe3b7f0bcf9b for instance e7393dbe-93cc-485c-93f0-7a5fa54e61b6 on hv-cinder-80152 Dec 17 12:38:30.681455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 112/209] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:30 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 1429 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:30.698913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-e60d9d55-db99-465d-9b00-f7754f93f882 req-d920688d-f511-420f-83f2-64b90badc9d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083097 Dec 17 12:38:30.701271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 98/210] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:38:31.087584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:31.088990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:31.110185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:31.112075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:31.113264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:31.113913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:31.202095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d12e079-9e15-44aa-b75f-d2d746076e27 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.119749 Dec 17 12:38:31.203375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 113/211] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:31 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:31.692374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:31.693161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] [instance: e7393dbe-93cc-485c-93f0-7a5fa54e61b6] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:31.702396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:31.706790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:31.709820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:31.710836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:31.730472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] HTTP exception thrown: Instance e7393dbe-93cc-485c-93f0-7a5fa54e61b6 could not be found. Dec 17 12:38:31.731392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] Returning 404 to user: Instance e7393dbe-93cc-485c-93f0-7a5fa54e61b6 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:31.732968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69c7dc4e-89e7-49b2-b0c5-e2b59d9efc66 tempest-VolumesNegativeTest-1350055948 tempest-VolumesNegativeTest-1350055948-project] 10.222.0.45 "GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6" status: 404 len: 111 microversion: 2.1 time: 0.046906 Dec 17 12:38:31.734046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 99/212] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:31 2021] GET /compute/v2.1/servers/e7393dbe-93cc-485c-93f0-7a5fa54e61b6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:38:32.066880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-315569627", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "1738f8ac-3144-4a29-8c86-ab024ec61052"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:32.221214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:32.224790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:32.246642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:32.260176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:32.262288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:32.264311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:32.372614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f3eb67a-bbb1-4f8f-abb6-0709d6324680 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.155745 Dec 17 12:38:32.377826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 100/213] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:32 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:32.719924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] validate_networks() for [('1738f8ac-3144-4a29-8c86-ab024ec61052', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:38:33.386391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:33.387492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:33.410449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:33.411023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:33.415464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:33.415927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:33.484062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:38:33.484612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:38:33.484933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:38:33.485539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:38:33.486121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:38:33.500179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:33.500781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:33.501739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:33.502382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:33.523364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:38:33.528604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for user 45f9bd776357421f97fb8530da002ef0 and project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:38:33.546638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:38:33.550312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:38:33.578057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-af52a02d-e7ab-453b-9d70-1a63ab7543c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.196901 Dec 17 12:38:33.578716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 101/214] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:33 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:33.629346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c6abadc5-f633-4828-b059-df0352c06209 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574146 Dec 17 12:38:33.636075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 114/215] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:38:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:38:33.644778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6ea1c2d-e1b6-42e3-8eae-a16d284d77d0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:33.645936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b6ea1c2d-e1b6-42e3-8eae-a16d284d77d0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:33.963016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b6ea1c2d-e1b6-42e3-8eae-a16d284d77d0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:33.986827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6ea1c2d-e1b6-42e3-8eae-a16d284d77d0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1217 microversion: 2.1 time: 0.344719 Dec 17 12:38:33.988029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 102/216] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:33 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1217 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:34.601187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:34.602344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:34.634742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:34.637658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:34.638854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:34.640576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:34.733195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c243a5a8-beee-459d-ab8d-978ff46bc21b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.145232 Dec 17 12:38:34.733772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 115/217] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:34 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:35.006526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:35.007739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:35.019675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:35.024033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:35.026544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:35.027994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:35.532502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:35.540672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2b8e1f5-05cb-4f2d-84bd-44a0533cdc19 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1277 microversion: 2.1 time: 0.538475 Dec 17 12:38:35.541089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 103/218] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:35 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1277 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:35.744972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:35.746548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:35.759028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:35.759475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:35.760738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:35.764246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:35.854074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-25fb80b1-589d-44d0-ab99-5ac9b6427ab4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.113383 Dec 17 12:38:35.855002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 116/219] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:35 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:35.966704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-736492510", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c9042d4-f1b7-4bb0-a03e-6a62434024fe"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:36.109162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] validate_networks() for [('1c9042d4-f1b7-4bb0-a03e-6a62434024fe', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:38:36.583386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:36.584260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:36.621338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.628604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:36.632079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.634846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:36.914149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:36.930440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d0429c2-016a-4870-bd4a-a30311335291 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.375490 Dec 17 12:38:36.939624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 117/220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:36 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:36.939624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:36.939624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:36.943555 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:38:36.944138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:38:36.944751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:38:36.945390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:38:36.945952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:38:36.947007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.947457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:36.952264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.952264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:36.970471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.970932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:36.971854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:36.972300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:37.015770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Getting quotas for project 43a479e98f4445759fa76f0a90380028. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:38:37.021012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Getting quotas for user 542a07a0f121447aa2e0ace9d59ab9ca and project 43a479e98f4445759fa76f0a90380028. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:38:37.039542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:38:37.042254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:38:37.055339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e2bd9884-6de3-4cee-9444-a810fc797bbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.121009 Dec 17 12:38:37.056215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 118/221] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:36 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:37.143444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3ee08b7c-6b65-4d4d-b7ea-2fbc54881309 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.337040 Dec 17 12:38:37.144490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 104/222] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:38:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:38:37.155217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dcd94b1c-41b1-401e-9ccd-150dd38aacbc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:37.157942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dcd94b1c-41b1-401e-9ccd-150dd38aacbc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:37.270189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dcd94b1c-41b1-401e-9ccd-150dd38aacbc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:37.280381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dcd94b1c-41b1-401e-9ccd-150dd38aacbc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1221 microversion: 2.1 time: 0.129084 Dec 17 12:38:37.284550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 119/223] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:37.498748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1087955871", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c9042d4-f1b7-4bb0-a03e-6a62434024fe"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:37.612964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] validate_networks() for [('1c9042d4-f1b7-4bb0-a03e-6a62434024fe', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:38:37.954034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:37.954646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:37.964921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:37.969911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:37.971407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:37.975196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.276540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:38.313557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b697ccad-4ac4-4ddb-8194-60fcc44016a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.365595 Dec 17 12:38:38.314225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 120/224] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:37 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:38.340634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:38.341717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:38.374035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:38.374503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.375309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:38.376810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.475504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-007df3f7-39ad-408c-8345-edcb818f57d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.147137 Dec 17 12:38:38.476175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 121/225] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:38 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:38.493746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-69f3f858-e8b0-40d7-bb3c-334a86f28bcf req-187193bf-93c3-46dc-85fc-5a3bce35dff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267952f7-83a0-44e8-801b-19f3dd7bad48", "tag": "17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:38.495664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:38.495664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:38:38.518583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-69f3f858-e8b0-40d7-bb3c-334a86f28bcf req-187193bf-93c3-46dc-85fc-5a3bce35dff6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:38.519086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-69f3f858-e8b0-40d7-bb3c-334a86f28bcf req-187193bf-93c3-46dc-85fc-5a3bce35dff6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.535341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-69f3f858-e8b0-40d7-bb3c-334a86f28bcf req-187193bf-93c3-46dc-85fc-5a3bce35dff6 service nova] Creating event network-changed:17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c for instance 267952f7-83a0-44e8-801b-19f3dd7bad48 on hv-cinder-80152 Dec 17 12:38:38.542654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-69f3f858-e8b0-40d7-bb3c-334a86f28bcf req-187193bf-93c3-46dc-85fc-5a3bce35dff6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061514 Dec 17 12:38:38.543563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 122/226] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:38.618869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:38:38.619846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:38:38.620660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:38:38.621224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:38:38.621968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:38:38.638105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:38.641135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.642588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:38.643241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:38.707831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Getting quotas for project 43a479e98f4445759fa76f0a90380028. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:38:38.720279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Getting quotas for user 542a07a0f121447aa2e0ace9d59ab9ca and project 43a479e98f4445759fa76f0a90380028. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:38:38.760659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:38:38.763587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:38:38.855591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce9d6f5d-4c6e-4637-b9d6-ffa6da6314c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.364377 Dec 17 12:38:38.856627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 105/227] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:38:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 17 12:38:38.867436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-205d247a-eceb-46c9-b791-b8660f651900 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:38.868129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-205d247a-eceb-46c9-b791-b8660f651900 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:38.950236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-205d247a-eceb-46c9-b791-b8660f651900 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:38.959124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-205d247a-eceb-46c9-b791-b8660f651900 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1222 microversion: 2.1 time: 0.096104 Dec 17 12:38:38.963205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 123/228] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:38 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:39.336251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:39.337561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:39.350072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:39.351379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:39.352518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:39.354519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:39.487206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:39.488126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:39.513434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:39.514234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:39.520517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:39.521061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:39.763802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f7127cbc-8352-4914-b69d-a0a16657445d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.280099 Dec 17 12:38:39.765024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 124/229] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:39 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:39.794241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:39.805907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3870e239-962f-4ef1-a652-9f8b8164a2f0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.477598 Dec 17 12:38:39.806533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 106/230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:39 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:39.980484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:39.981767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:39.999307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.001040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:40.011669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.012129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:40.220271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:40.229558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-08cfc60d-868e-433d-921c-7a5316dfae8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1218 microversion: 2.1 time: 0.253815 Dec 17 12:38:40.233638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 125/231] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:39 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:40.775999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:40.777093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:40.787338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.793918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:40.796696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.800242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:40.840045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:40.841006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:40.848462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.849176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:40.850872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:40.851507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:41.044109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d8c2aad-08eb-4705-92fb-1d8a7ff4f277 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28273 microversion: 2.20 time: 0.272291 Dec 17 12:38:41.046728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 107/232] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:40 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:41.249713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:41.250481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:41.267535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:41.267985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:41.273445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:41.274262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:41.408084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:41.424819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:41.428759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-931eb564-3407-41a2-b314-1705b7094135 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.606450 Dec 17 12:38:41.436487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 126/233] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:40 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:41.444091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e515b55-9ff5-4d4e-978e-710dcf8eaa9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1280 microversion: 2.1 time: 0.197884 Dec 17 12:38:41.447856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 108/234] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:41 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:41.741094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-7090fb0a-c436-4971-b2dc-098b41493d19 req-859cf375-bb64-47cf-b21b-b7481d4d26af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d1af76-68e9-4515-8374-ecae895e7c09", "tag": "463f65d4-93e2-4912-bcb9-b68da01362d5"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:41.749123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:41.749123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:38:41.759696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7090fb0a-c436-4971-b2dc-098b41493d19 req-859cf375-bb64-47cf-b21b-b7481d4d26af service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:41.765823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7090fb0a-c436-4971-b2dc-098b41493d19 req-859cf375-bb64-47cf-b21b-b7481d4d26af service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:41.778996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-7090fb0a-c436-4971-b2dc-098b41493d19 req-859cf375-bb64-47cf-b21b-b7481d4d26af service nova] Creating event network-changed:463f65d4-93e2-4912-bcb9-b68da01362d5 for instance 21d1af76-68e9-4515-8374-ecae895e7c09 on hv-cinder-80152 Dec 17 12:38:41.784309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-7090fb0a-c436-4971-b2dc-098b41493d19 req-859cf375-bb64-47cf-b21b-b7481d4d26af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046638 Dec 17 12:38:41.785464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 127/235] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:42.057710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:42.059174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:42.066246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.066849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.067959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.068662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.160579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a97bfa91-5aeb-45e5-909f-3902ce58b25a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28564 microversion: 2.20 time: 0.107609 Dec 17 12:38:42.164894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 109/236] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:42 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28564 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:42.452873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:42.453597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:42.460982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.461462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.462260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.462687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.467414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:42.468271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:42.475775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.476620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.477698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:42.478223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:42.708694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:42.720978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-18fcdef1-251e-4894-8f9a-d8d1efd22d05 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.272476 Dec 17 12:38:42.722004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 128/237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:42 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:42.917919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:42.925705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2b3ae712-e377-44a2-8575-60a707bb5110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.463465 Dec 17 12:38:42.926609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 110/238] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:42 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:43.172215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:43.173242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:43.180017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.180668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.181682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.182330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.279382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-56bc9f00-cd7c-4eb9-a073-afdcd58db9a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28564 microversion: 2.20 time: 0.110714 Dec 17 12:38:43.280067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 129/239] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:43 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28564 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:43.403334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-0f2b75a1-ea26-4265-84c3-f0073c743ee5 req-6d4e46dc-7386-44ec-a8d3-11b2b2b214a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff9ce5c-0be8-4a60-a8fb-07a859af79be", "tag": "861c09f7-e685-428c-883b-0b264853eca6"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:43.408222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:43.408222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:38:43.434006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0f2b75a1-ea26-4265-84c3-f0073c743ee5 req-6d4e46dc-7386-44ec-a8d3-11b2b2b214a8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.434623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0f2b75a1-ea26-4265-84c3-f0073c743ee5 req-6d4e46dc-7386-44ec-a8d3-11b2b2b214a8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.447805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-0f2b75a1-ea26-4265-84c3-f0073c743ee5 req-6d4e46dc-7386-44ec-a8d3-11b2b2b214a8 service nova] Creating event network-changed:861c09f7-e685-428c-883b-0b264853eca6 for instance dff9ce5c-0be8-4a60-a8fb-07a859af79be on hv-cinder-80152 Dec 17 12:38:43.455078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-0f2b75a1-ea26-4265-84c3-f0073c743ee5 req-6d4e46dc-7386-44ec-a8d3-11b2b2b214a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059853 Dec 17 12:38:43.455681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 111/240] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:43.740996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:43.742974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:43.752427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.753216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.754551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.755317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.942910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:43.944944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:43.953331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.953960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.955153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:43.955975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:43.961007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:43.970754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4ed9e552-fd3a-4a24-b8b1-6a5052fda57d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.235935 Dec 17 12:38:43.972044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 130/241] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:43 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:44.291158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:44.292088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:44.300366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:44.301870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:44.302311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:44.303139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:44.303568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:44.308660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0050e5b9-6370-4d08-9487-bb7113f439b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.370074 Dec 17 12:38:44.309252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 112/242] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:43 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:44.479594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4345096c-cf69-480d-872d-c172f9518066 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.191729 Dec 17 12:38:44.485385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 131/243] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:44 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:44.988765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:44.989988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:44.997615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:44.998066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:44.998850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:44.999282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:45.161337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:45.168652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aef8010c-8cce-4b80-a747-266abb32771a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.184512 Dec 17 12:38:45.169158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 113/244] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:44 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:45.325621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:45.326686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:45.333680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:45.334148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:45.335072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:45.335565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:45.472947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:45.481344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8c262ac0-8bb8-428b-9d3a-380c37eeea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.159660 Dec 17 12:38:45.482087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 132/245] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:45 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:45.532100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:45.533454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:45.544230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:45.545053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:45.546193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:45.546851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:45.796234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-65de6345-7dc7-40a3-ae63-2cded19358c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.267622 Dec 17 12:38:45.796968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 114/246] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:45 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:46.185187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:46.185878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:46.192373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.192812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.193624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.194048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.337818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:46.345291 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-588ac906-dd69-48a5-b05f-a6fe005b282d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.163704 Dec 17 12:38:46.345867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 133/247] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:46 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:46.499198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:46.499976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:46.507234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.507785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.508647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.509261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.661979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:46.670302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4e2c80c-3bdb-42ae-b6ae-bcf9ff06dda7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.175181 Dec 17 12:38:46.670904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 115/248] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:46 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:46.809710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:46.810744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:46.818083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.818767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.819609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:46.820210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:46.971793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-07101e9a-e944-44ae-b2fc-85c98605a1ed tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.167160 Dec 17 12:38:46.972665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 134/249] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:46 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:47.362661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:47.363263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:47.370163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.370603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:47.371380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.371811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:47.509127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:47.516676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d638a1dd-4943-415d-9a10-89c706f51444 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.157828 Dec 17 12:38:47.517244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 116/250] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:47 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:47.687788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:47.688554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:47.695724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.696158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:47.696925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.697396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:47.837681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:47.845074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9eba4327-b918-4902-a90a-264ba1ccf75e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.161471 Dec 17 12:38:47.845690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 135/251] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:47 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:47.984137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:47.985143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:47.991685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.992124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:47.992916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:47.993376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:48.080494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ed5cf422-ed7f-41a8-83f2-3c8cc92092e6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.099336 Dec 17 12:38:48.081523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 117/252] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:47 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:48.534371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:48.535282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:48.542072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:48.542595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:48.543386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:48.543842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:48.562579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-07df13fe-9ffa-4aa7-8b07-9616ebfe6ac2 req-a036dc28-749d-4f6a-9d8a-7b9201d1a9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267952f7-83a0-44e8-801b-19f3dd7bad48", "name": "network-vif-plugged", "status": "completed", "tag": "17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:48.565063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:48.565063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:38:48.574598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-07df13fe-9ffa-4aa7-8b07-9616ebfe6ac2 req-a036dc28-749d-4f6a-9d8a-7b9201d1a9fb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:48.574803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-07df13fe-9ffa-4aa7-8b07-9616ebfe6ac2 req-a036dc28-749d-4f6a-9d8a-7b9201d1a9fb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:48.603193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-07df13fe-9ffa-4aa7-8b07-9616ebfe6ac2 req-a036dc28-749d-4f6a-9d8a-7b9201d1a9fb service nova] Creating event network-vif-plugged:17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c for instance 267952f7-83a0-44e8-801b-19f3dd7bad48 on hv-cinder-80152 Dec 17 12:38:48.608178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-07df13fe-9ffa-4aa7-8b07-9616ebfe6ac2 req-a036dc28-749d-4f6a-9d8a-7b9201d1a9fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050379 Dec 17 12:38:48.608789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 118/253] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:38:48.698917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:48.707394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d313a9c-f519-499a-ab71-783f9335ae68 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.177296 Dec 17 12:38:48.708077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 136/254] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:48 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:48.862115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:48.862707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:48.869395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:48.869840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:48.870735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:48.871168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:49.013426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:49.021097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dc423e81-23a4-4cf2-85d9-0720fdc1d39c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.163085 Dec 17 12:38:49.031091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 119/255] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:48 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:49.095158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:49.096374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:49.105883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:49.106330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:49.107122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:49.107551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:49.175918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac5160c7-b0b0-4aae-9f08-71d6de4a1085 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.084688 Dec 17 12:38:49.176585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 137/256] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:49 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:49.723840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:49.724419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:49.730912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:49.731388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:49.732161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:49.732590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:49.871961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:49.881208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f62beb6-e8bb-433a-8650-b8eded612917 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.160926 Dec 17 12:38:49.881840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 120/257] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:49 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:50.038656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:50.039343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:50.046566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.047009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:50.047789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.048221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:50.185592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:50.187887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:50.188851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:50.193168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fb57ef65-3c99-46e2-a5ed-e3fcd860aff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.158556 Dec 17 12:38:50.193878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 138/258] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:50 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:50.195147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.195663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:50.196401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.196786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:50.279026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-01818a67-a9c1-468a-95f9-026d441b8e91 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.090823 Dec 17 12:38:50.279026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 121/259] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:50 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:50.898191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:50.899028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:50.906013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.906390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:50.907191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:50.907784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:51.055824 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:51.065151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e0b6f4af-6c02-421f-b482-f4346a0c3269 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1317 microversion: 2.1 time: 0.171260 Dec 17 12:38:51.066511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 139/260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:50 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:51.213326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:51.213963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:51.220966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:51.221468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:51.222299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:51.222736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:51.286799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:51.287780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:51.294676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:51.295077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:51.295863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:51.296473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:51.380233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-36c9239d-85d5-42c9-b132-ceed3754a2c9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.096991 Dec 17 12:38:51.380899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 140/261] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:51 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:38:51.430071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:51.437652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-000a5bb2-14a1-499c-b35f-b224902f4f59 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.230586 Dec 17 12:38:51.438191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 122/262] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:51 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:52.082849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:52.083539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.092475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.092803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.094297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.094753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.244990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:52.254924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-31cb4295-efed-42ff-b492-0243f09966f2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1508 microversion: 2.1 time: 0.175697 Dec 17 12:38:52.255847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 141/263] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:52 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:52.271946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd5810b-c2b2-4e61-a439-c666de55e9d6"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:52.273025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.279560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.280176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.281176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.281782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.369844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Invalid volume: volume bbd5810b-c2b2-4e61-a439-c666de55e9d6 is already attached to instances: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 Dec 17 12:38:52.370457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 400 to user: Invalid volume: volume bbd5810b-c2b2-4e61-a439-c666de55e9d6 is already attached to instances: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:38:52.371313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2db41938-7788-4271-a5d2-3ae2c42ef47a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103444 Dec 17 12:38:52.371894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 123/264] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:38:52 2021] POST /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:38:52.392022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:52.393220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.400791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.401240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.402081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.402505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.435110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:52.435847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.444551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.446016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.447005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.447720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.532277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7eb6199e-a788-4b86-bb29-af8b1166e33a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.143759 Dec 17 12:38:52.533614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 142/265] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:52 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:52.538495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:52.538581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.545841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.546499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.547480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.548079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.609835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lazy-loading 'services' on Instance uuid 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:38:52.859387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:52.867336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-94b3332a-ca7f-4968-8727-7a25d77d3f5e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.333263 Dec 17 12:38:52.868152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 143/266] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:52 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:52.872776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-bd95a3db-dcc6-48b6-ad79-39c189aff6f5 req-19f694dc-dd7a-4afb-bd05-503014e76156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d1af76-68e9-4515-8374-ecae895e7c09", "name": "network-vif-plugged", "status": "completed", "tag": "463f65d4-93e2-4912-bcb9-b68da01362d5"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:52.874319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:52.874319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:38:52.888476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-bd95a3db-dcc6-48b6-ad79-39c189aff6f5 req-19f694dc-dd7a-4afb-bd05-503014e76156 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.888900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-bd95a3db-dcc6-48b6-ad79-39c189aff6f5 req-19f694dc-dd7a-4afb-bd05-503014e76156 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.898671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f885569-7e51-426d-963b-c6cbf5c69ab8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments/bbd5810b-c2b2-4e61-a439-c666de55e9d6" status: 202 len: 0 microversion: 2.1 time: 0.467798 Dec 17 12:38:52.902724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 124/267] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:38:52 2021] DELETE /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments/bbd5810b-c2b2-4e61-a439-c666de55e9d6 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:52.902839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-bd95a3db-dcc6-48b6-ad79-39c189aff6f5 req-19f694dc-dd7a-4afb-bd05-503014e76156 service nova] Creating event network-vif-plugged:463f65d4-93e2-4912-bcb9-b68da01362d5 for instance 21d1af76-68e9-4515-8374-ecae895e7c09 on hv-cinder-80152 Dec 17 12:38:52.905934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-bd95a3db-dcc6-48b6-ad79-39c189aff6f5 req-19f694dc-dd7a-4afb-bd05-503014e76156 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036378 Dec 17 12:38:52.906537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 144/268] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:52.926798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:52.927863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:52.935170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.935896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.937369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:52.938305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:52.973016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c0d224a-71c8-4127-8036-5e5a6bfb87c1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068732 Dec 17 12:38:52.973852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 125/269] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:38:52 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:38:53.545616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:53.546913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:53.554364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:53.555087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:53.555928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:53.556555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:53.687259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a3d912e-13cd-4062-a77f-75690e981924 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.146156 Dec 17 12:38:53.688260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 145/270] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:53 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:53.884290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:53.884856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:53.893786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:53.894560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:53.895778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:53.896462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:53.984650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:53.985680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:53.998435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:53.999604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:54.004028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:54.004644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:54.057816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30ff090b-e6eb-4df0-9afb-23f1c215d557 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076881 Dec 17 12:38:54.058517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 146/271] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:38:53 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:38:54.080700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:54.088647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e08835b-6303-479f-9de7-826dc82b307d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.208447 Dec 17 12:38:54.099196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 126/272] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:53 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:54.704164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:54.705664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:54.714313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:54.714839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:54.715736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:54.716312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:54.782170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d7d76dbc-2484-4fcb-b999-df1ec2700575 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.084289 Dec 17 12:38:54.783033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 147/273] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:54 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:54.933610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-f297b96b-439c-47e6-ba21-9c4d60b23ed9 req-299e269f-625f-49b0-bd22-ad6bcb5053c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff9ce5c-0be8-4a60-a8fb-07a859af79be", "name": "network-vif-plugged", "status": "completed", "tag": "861c09f7-e685-428c-883b-0b264853eca6"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:54.935136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:38:54.935136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:38:54.942772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f297b96b-439c-47e6-ba21-9c4d60b23ed9 req-299e269f-625f-49b0-bd22-ad6bcb5053c5 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:54.943262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-f297b96b-439c-47e6-ba21-9c4d60b23ed9 req-299e269f-625f-49b0-bd22-ad6bcb5053c5 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:54.955664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-f297b96b-439c-47e6-ba21-9c4d60b23ed9 req-299e269f-625f-49b0-bd22-ad6bcb5053c5 service nova] Creating event network-vif-plugged:861c09f7-e685-428c-883b-0b264853eca6 for instance dff9ce5c-0be8-4a60-a8fb-07a859af79be on hv-cinder-80152 Dec 17 12:38:54.960665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-f297b96b-439c-47e6-ba21-9c4d60b23ed9 req-299e269f-625f-49b0-bd22-ad6bcb5053c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Dec 17 12:38:54.961263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 127/274] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:38:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:38:55.069666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:55.071007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:55.079083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.079526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.080310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.080740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.109226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:55.110351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:55.112140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d9e9701-3575-416b-9fb4-fc8e3fabaeb7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046751 Dec 17 12:38:55.117257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 148/275] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:38:55 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:38:55.129484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.129931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.130718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.131151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.289918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:55.297363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-50172ec4-d7ae-4a28-b26a-c6ce9cac50ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.195320 Dec 17 12:38:55.297936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 128/276] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:55 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:55.305446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2080922324", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "1738f8ac-3144-4a29-8c86-ab024ec61052"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:55.361397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] validate_networks() for [('1738f8ac-3144-4a29-8c86-ab024ec61052', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:38:55.735583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:38:55.736193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:38:55.736445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:38:55.736875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:38:55.737294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:38:55.746731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.747202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.747970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.748429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.765321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:38:55.769157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for user 45f9bd776357421f97fb8530da002ef0 and project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:38:55.780447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:38:55.782837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:38:55.796383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:55.797591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:55.804086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.804529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.805587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:55.806018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:55.831944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eab9388f-6d62-40aa-8fe4-0acd293268cc tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530709 Dec 17 12:38:55.832759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 149/277] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:38:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:38:55.842574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fa575ecd-c9ad-4375-859d-7d3e69dbafd0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:55.843181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fa575ecd-c9ad-4375-859d-7d3e69dbafd0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:55.883284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-651168f5-48a3-4dc5-91b5-ce6e823bcada tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.090599 Dec 17 12:38:55.883936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 129/278] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:55 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:38:55.906671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fa575ecd-c9ad-4375-859d-7d3e69dbafd0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:55.913250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fa575ecd-c9ad-4375-859d-7d3e69dbafd0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1218 microversion: 2.1 time: 0.074351 Dec 17 12:38:55.913957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 150/279] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:55 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:56.315331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:56.315913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:56.323223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.323896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.324694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.325113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.470933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:56.478494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3b654080-11f9-4594-8c9b-60fcb61c7fd2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.167265 Dec 17 12:38:56.479431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 130/280] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:56 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:56.895421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:38:56.896404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:56.903236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.903682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.904486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.904914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.929894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:56.931254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:56.938017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.938472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.939250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:56.939683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:56.998377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:57.006178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca1f3798-39e8-4331-8fa9-116a21b935a5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1222 microversion: 2.1 time: 0.079966 Dec 17 12:38:57.006728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 131/281] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:56 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:57.495806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:57.496530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:57.505134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:57.505793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:57.506831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:57.507426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:57.651516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:57.659005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2057c13-80ef-4c95-87ae-7777ddc6e82c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.167944 Dec 17 12:38:57.659568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 132/282] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:57 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:38:58.026632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:58.027648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:58.038234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:58.039016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:58.040280 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:58.041003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:58.106824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:58.117911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a6ab0efe-9e36-49b7-998d-9e3565f04530 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1222 microversion: 2.1 time: 0.097486 Dec 17 12:38:58.118508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 133/283] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:58 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:58.676112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:58.676681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:58.683297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:58.683740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:58.684501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:58.684928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:58.817219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:58.825133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-faec3a2f-ac4a-4274-8522-c8243394fedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.152997 Dec 17 12:38:58.825745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 134/284] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:58 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:59.137687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:59.138620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:59.148679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:59.149343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:59.150560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:59.151255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:59.216444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:59.223808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a2368aaa-da0a-4245-ba0c-135638a87cd6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1222 microversion: 2.1 time: 0.091917 Dec 17 12:38:59.224384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 135/285] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:59 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:38:59.842981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:38:59.843632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:38:59.851089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:59.851680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:59.852472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:38:59.852900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:38:59.985583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:38:59.992870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6929ffc0-fa8c-4769-b870-8bd95cc9ebcb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.154344 Dec 17 12:38:59.993527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 136/286] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:38:59 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:00.244228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:00.245217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:00.257304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:00.258625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:00.260970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:00.262312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:00.330959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:00.338534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2c2df859-73ce-45a3-bf01-f685d7ef340b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1222 microversion: 2.1 time: 0.100624 Dec 17 12:39:00.339104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 137/287] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:00 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:01.009446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:01.010200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:01.016665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:01.017111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:01.017934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:01.018363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:01.158479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:01.166110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-47849ee4-e095-4e87-b608-2103a67e4dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.160429 Dec 17 12:39:01.166683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 138/288] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:01 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:01.356149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:01.356680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:01.363348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:01.363794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:01.364573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:01.365001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:01.421904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:01.429509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0bdb5909-9198-4991-a653-19302825c8d7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1222 microversion: 2.1 time: 0.077073 Dec 17 12:39:01.430073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 139/289] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:01 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:02.029734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e70271c0-c6ee-4227-80b5-6f4ec50de2a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 5.137903 Dec 17 12:39:02.031071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 151/290] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:38:56 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 5140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:02.182357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:02.183089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:02.190196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:02.190642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:02.191457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:02.191890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:02.327407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:02.335305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4b66bd97-34d1-489a-a9eb-1fbbe423ebf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1322 microversion: 2.1 time: 0.156995 Dec 17 12:39:02.335882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 140/291] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:02 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:02.450795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:02.452301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:02.462739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:02.463178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:02.463952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:02.464380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:02.525902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:02.535898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8d1a10d3-4df8-4d91-b14f-61c6d0df0321 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1270 microversion: 2.1 time: 0.091962 Dec 17 12:39:02.536481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 152/292] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:02 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:03.042397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:03.044540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:03.051337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.051899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.052741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.053490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.176711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1f7d62b-2c03-4ea3-b06a-658877d2f0a9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.138053 Dec 17 12:39:03.177415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 141/293] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:03 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:03.351948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:03.352577 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:03.358984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.359605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.360397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.361138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.557934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:03.558975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:03.567175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.567811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.569036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.569650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.581038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:03.592274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1c0fb5db-438b-46cf-97d8-74a535231bb8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1515 microversion: 2.1 time: 0.243963 Dec 17 12:39:03.592984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 153/294] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:03 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:03.614566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:03.618319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:03.625868 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.626335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.628092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.628092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.657964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lazy-loading 'flavor' on Instance uuid dff9ce5c-0be8-4a60-a8fb-07a859af79be {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:39:03.751834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:03.760429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-648cc430-984d-473f-a99f-4673badcc915 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.206924 Dec 17 12:39:03.761015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 142/295] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:03 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:03.797004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c245eae-2fec-4595-86b3-0a73e3842dfe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be/action" status: 200 len: 32 microversion: 2.1 time: 0.191267 Dec 17 12:39:03.797863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 154/296] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:39:03 2021] POST /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:39:03.807557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:03.808298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:03.814608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.815128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.815981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:03.816479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:03.965610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:03.973703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f379aca-8e94-4c10-832c-44512649b3e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.169805 Dec 17 12:39:03.974600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 143/297] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:03 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:04.189439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:04.190455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:04.197484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.198242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.199208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.199788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.236242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-4e7c3c2f-b1d1-4d85-be72-86e8db17476b req-e1f01f26-9a8e-40e7-a4f1-ca8cd8a6a0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba020eb-5d3a-4c81-a3d6-82feee675c3a", "tag": "c6b6b500-279e-46dd-b498-2586758dd9fb"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:04.238442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:04.238442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:39:04.247930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4e7c3c2f-b1d1-4d85-be72-86e8db17476b req-e1f01f26-9a8e-40e7-a4f1-ca8cd8a6a0d9 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.248581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4e7c3c2f-b1d1-4d85-be72-86e8db17476b req-e1f01f26-9a8e-40e7-a4f1-ca8cd8a6a0d9 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.261188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-4e7c3c2f-b1d1-4d85-be72-86e8db17476b req-e1f01f26-9a8e-40e7-a4f1-ca8cd8a6a0d9 service nova] Creating event network-changed:c6b6b500-279e-46dd-b498-2586758dd9fb for instance 0ba020eb-5d3a-4c81-a3d6-82feee675c3a on hv-cinder-80152 Dec 17 12:39:04.266697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-4e7c3c2f-b1d1-4d85-be72-86e8db17476b req-e1f01f26-9a8e-40e7-a4f1-ca8cd8a6a0d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035006 Dec 17 12:39:04.268072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 144/298] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:04.301640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7da0e2b3-1698-4f00-9be3-a97b38555c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.116047 Dec 17 12:39:04.302318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 155/299] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:04 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:04.780734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:04.781536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:04.788596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.789140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.790589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.790589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.933527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:04.940841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8472f3d5-5234-45a5-b3d5-e111fe825fa4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.165899 Dec 17 12:39:04.941517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 145/300] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:04 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:04.991013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:04.991699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:04.998467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:04.998911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:04.999680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:05.000106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:05.227784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:05.235591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59e92ee5-e639-4595-80e2-fc8d47400b45 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.248613 Dec 17 12:39:05.236163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 156/301] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:04 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:05.312446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:05.313435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:05.319248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:05.319684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:05.320511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:05.320941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:05.443491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30972f6c-bad8-42b5-8c79-3b1e040453d2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.134565 Dec 17 12:39:05.444364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 146/302] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:05 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:05.957920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:05.958436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:05.965126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:05.965589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:05.966363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:05.966789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:06.156695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:06.164179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f4b4d3b4-2b2e-4460-867e-bd6c224df9f9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.210054 Dec 17 12:39:06.164716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 157/303] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:05 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:06.252448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:06.253263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:06.260644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:06.261311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:06.262188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:06.262551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:06.396229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:06.404084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2728c373-d6c7-4cf1-aeea-d144b2ffbc3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.155760 Dec 17 12:39:06.404650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 147/304] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:06 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:06.460318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:06.461381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:06.468029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:06.468477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:06.469335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:06.469726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:06.535640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f3361e4e-b686-4785-9890-0de516b9b681 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.079137 Dec 17 12:39:06.536549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 158/305] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:06 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:07.180980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:07.181614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:07.188019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.188472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.189249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.189712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.319424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:07.327155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b44c734f-32a5-47be-b8ce-9069063aac33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.149973 Dec 17 12:39:07.327850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 148/306] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:07 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:07.421827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:07.422524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:07.429766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.430221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.431007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.431445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.548055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:07.549251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:07.556397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.557163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.558228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:07.558707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:07.562664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:07.570802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-620c94af-a920-4539-a378-e2ad4497d508 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.153098 Dec 17 12:39:07.574955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 159/307] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:07 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:07.686677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4197a047-0f61-4d29-8769-ed680d3c42a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.142310 Dec 17 12:39:07.687454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 149/308] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:07 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:08.343544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:08.344151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:08.350540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.350989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.351837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.352439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.492492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:08.502041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2056c74a-6c27-4c19-a488-919b9d996569 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.160354 Dec 17 12:39:08.502041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 160/309] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:08 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:08.591315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:08.592048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:08.598271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.598710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.599483 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.599906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.702697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:08.703839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:08.715603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.715603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.715603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:08.715603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:08.764189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:08.772300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-293d284e-1ebb-4ba8-bf6b-7aebf255f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.185044 Dec 17 12:39:08.772964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 150/310] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:08 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:08.785505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f5f3232a-c918-4ab2-a408-3ff5b6f6c4cd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.089408 Dec 17 12:39:08.786536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 161/311] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:08 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:09.516035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:09.516640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:09.532094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.532532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.533793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.533793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.669627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:09.677575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-13d4bd1a-2138-4685-b4c8-67342b7967f1 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.165139 Dec 17 12:39:09.678164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 151/312] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:09 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:09.792008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:09.792952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:09.797919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:09.798921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:09.805606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.805775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.806033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.806438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.806829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.807254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.807888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:09.808524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:09.902336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1449b031-0b82-4187-b6fc-bf234f8b873e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.107974 Dec 17 12:39:09.903270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 152/313] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:09 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:09.980360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:09.989986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b7b0b0c2-e4fb-4e89-aac2-8c196ecfd523 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.202217 Dec 17 12:39:09.991241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 162/314] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:09 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:10.696643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:10.697368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:10.704828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:10.705266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:10.706060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:10.706484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:10.844517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:10.855417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd0607e6-5562-4c62-95f8-43c70fa4cc9a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.162654 Dec 17 12:39:10.856141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 153/315] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:10 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:10.918251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:10.919718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:10.930352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:10.930744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:10.931557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:10.931989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:10.997507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-05a9f477-b63f-4184-9ee0-613e10a4affc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.085535 Dec 17 12:39:10.998165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 163/316] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:10 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:11.007015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:11.007776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:11.014024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:11.014503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:11.015286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:11.015722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:11.147455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:11.154766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-82c470bb-1350-4c9c-9b4f-7fc2b665248b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.151587 Dec 17 12:39:11.155321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 154/317] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:11 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:11.877684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:11.878541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:11.886390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:11.886837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:11.887619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:11.888048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.009318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:12.010255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:12.017053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.017501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.018265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.018695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.022442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:12.031405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-75436ae2-c4d3-4f65-8b33-d02328482376 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.158568 Dec 17 12:39:12.032280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 164/318] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:11 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:12.175219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:12.176635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:12.184537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.184988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.185836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.186270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.317586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:12.329132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8921ac43-3a45-4bef-87dd-c6c252d4a3f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.159909 Dec 17 12:39:12.329936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 165/319] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:12 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:12.569420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1843205332", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "d206fb98-6362-4397-a6bd-3bd32539cecc"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:12.620437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-97f9c5a4-d467-45d5-9d92-3484b115ed6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.614656 Dec 17 12:39:12.624433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 155/320] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:12 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:12.628504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] validate_networks() for [('d206fb98-6362-4397-a6bd-3bd32539cecc', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:39:12.966307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:39:12.966906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:39:12.967546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:39:12.968126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:39:12.968673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:39:12.982513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.983104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:12.984305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:12.984929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.003720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Getting quotas for project 8722c81a36bb4493b0aa4c34f7ba146d. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:39:13.008084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Getting quotas for user a547f32803db45e2b0f1291d8abd7669 and project 8722c81a36bb4493b0aa4c34f7ba146d. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:39:13.020053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:39:13.022368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:39:13.048475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:13.049267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:13.056973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.057454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.058246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.058663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.067617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4b674b6-d6d1-4828-b871-40997585ebd6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501841 Dec 17 12:39:13.068453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 166/321] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:39:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:39:13.078521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-58e2df31-c2e8-4423-87d3-4618cee469b6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:13.079216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-58e2df31-c2e8-4423-87d3-4618cee469b6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:13.136499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58e2df31-c2e8-4423-87d3-4618cee469b6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:13.143659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-58e2df31-c2e8-4423-87d3-4618cee469b6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1219 microversion: 2.1 time: 0.069194 Dec 17 12:39:13.144402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 167/322] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:13.193373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:13.201690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac100bc1-1fde-4b94-a933-4a5f4bbdb097 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.156824 Dec 17 12:39:13.202528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 156/323] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:13 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:13.346976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:13.347579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:13.353754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.354206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.355026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.355462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.489841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:13.501324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-480a24be-ec91-4611-bc00-0cd90b65acc1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.157804 Dec 17 12:39:13.502152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 168/324] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:13 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:13.637854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:13.639436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:13.651073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.651518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:13.652297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:13.652722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.164370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:14.165303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:14.171989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.172434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.173206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.173666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.239043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:14.246793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2d21ec0b-361b-4273-8766-8d9232974b74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1223 microversion: 2.1 time: 0.088557 Dec 17 12:39:14.247349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 169/325] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:14.251468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:14.252057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:14.257909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.258466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.259383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.259901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.390274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:14.401670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0fc3fc21-d84e-4b29-8666-9cc3abc0a9b2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.153398 Dec 17 12:39:14.402238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 170/326] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:14 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:14.523621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:14.524606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:14.531532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.532049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.532890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:14.533416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:14.671877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:14.679694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66669ead-a9c5-40c1-acfe-9d649ccbc10d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.162177 Dec 17 12:39:14.680399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 171/327] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:14 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:15.267781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:15.268805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:15.278062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.278515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.279301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.279737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.348438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:15.349768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11a018e2-33cd-46f8-bb37-687d861bc282 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1223 microversion: 2.1 time: 0.088377 Dec 17 12:39:15.350336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 172/328] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:15 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:15.426512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:15.427499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:15.435723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.436175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.436956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.437436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.567616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:15.578163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8dca39ae-eaeb-4a3d-bebc-d75da93040c9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.157635 Dec 17 12:39:15.578735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 173/329] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:15 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:15.699475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:15.700383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:15.710401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.711081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.712254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:15.712908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:15.850182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:15.858018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e14271eb-da96-41bc-b299-419b4c0b5ddd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.164328 Dec 17 12:39:15.858594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 174/330] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:15 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:16.370116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:16.371090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:16.377932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.378556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.379147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.379613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.437174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:16.444806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-09f9f2bd-7f67-42d0-8640-37dfa84d5ae5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1223 microversion: 2.1 time: 0.080898 Dec 17 12:39:16.445407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 175/331] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:16.601123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:16.602179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:16.610219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.610596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.611371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.611801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.705747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07f49d0e-9a79-4f63-89ec-7e8103b0143d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 3.075548 Dec 17 12:39:16.709921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 157/332] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:13 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 3078 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:16.758802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:16.770531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7e277fe9-8e8b-46f5-bdcf-09f43daec4f7 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.175263 Dec 17 12:39:16.771209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 176/333] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:16 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:16.851315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-de9e751c-ee4b-4f04-9456-175298ed542e req-1cd16d16-f3db-4929-9f89-9844bb35592e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba020eb-5d3a-4c81-a3d6-82feee675c3a", "name": "network-vif-plugged", "status": "completed", "tag": "c6b6b500-279e-46dd-b498-2586758dd9fb"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:16.853183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:16.853183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:39:16.861530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-de9e751c-ee4b-4f04-9456-175298ed542e req-1cd16d16-f3db-4929-9f89-9844bb35592e service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.861986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-de9e751c-ee4b-4f04-9456-175298ed542e req-1cd16d16-f3db-4929-9f89-9844bb35592e service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.874948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:16.875516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-de9e751c-ee4b-4f04-9456-175298ed542e req-1cd16d16-f3db-4929-9f89-9844bb35592e service nova] Creating event network-vif-plugged:c6b6b500-279e-46dd-b498-2586758dd9fb for instance 0ba020eb-5d3a-4c81-a3d6-82feee675c3a on hv-cinder-80152 Dec 17 12:39:16.875843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:16.880864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-de9e751c-ee4b-4f04-9456-175298ed542e req-1cd16d16-f3db-4929-9f89-9844bb35592e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033599 Dec 17 12:39:16.882033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 158/334] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:16.883906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.884556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:16.885763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:16.886280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.031051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:17.038294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-db2ef29a-46bc-4af0-abf7-e99dfa9e6bc6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.167643 Dec 17 12:39:17.038852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 177/335] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:16 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:17.462718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:17.463468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:17.470499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.470939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.471738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.472177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.532140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:17.539537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d829a6bf-d430-4052-a6bb-85f09827f48f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1271 microversion: 2.1 time: 0.081323 Dec 17 12:39:17.540119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 159/336] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:17.717949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:17.718928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:17.725644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.726093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.726872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.727300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.787404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:17.788058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:17.794664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.795108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.795877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:17.796567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:17.830937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e045af16-bc65-4330-9e1c-563c25f2c6a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.116693 Dec 17 12:39:17.831759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 178/337] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:17 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:17.941218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:17.950097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07ba9d32-0c0c-4a18-b088-e8fbeae5834b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.166332 Dec 17 12:39:17.951849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 160/338] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:17 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:18.055182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:18.055962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:18.063015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.063568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.064449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.064975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.274237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:18.284423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3b7bf8b2-9756-4641-95f5-2f4286487c6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.233259 Dec 17 12:39:18.285027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 179/339] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:18 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:18.557060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:18.557699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:18.564151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.564605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.565397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.565828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.706730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:18.714230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2e9428ff-088b-4597-bd84-9b8adc49f614 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.160835 Dec 17 12:39:18.714795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 161/340] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:18.843387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:18.844312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:18.851029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.851473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.852252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.852685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.983811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:18.984574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:18.990947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.991405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:18.992184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:18.992611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:19.125593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:19.133168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e70019eb-9a9c-4ca0-8a27-0395ffa06677 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.154335 Dec 17 12:39:19.133766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 162/341] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:18 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:19.305036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:19.306049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:19.313689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:19.314245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:19.315068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:19.315526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:19.453017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:19.461062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f243833f-d0f3-4191-a93a-59a73836ca66 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.162041 Dec 17 12:39:19.461783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 163/342] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:19 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:19.731712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:19.732216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:19.738766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:19.739180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:19.739989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:19.740422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:19.870059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:19.882277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a15794d4-8b9b-49e9-91fb-c100572f5f3a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.154226 Dec 17 12:39:19.883198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 164/343] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:20.153882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:20.154660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:20.162327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.162846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:20.163751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.164254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:20.300379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:20.310115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c535772-8b46-4cef-af92-ed3db14db6eb tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.161953 Dec 17 12:39:20.310877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 165/344] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:20 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:20.481883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:20.482889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:20.493042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.493845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:20.495128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.495853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:20.632841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:20.640577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5258859-9b9d-4805-acb0-4671d546817f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.164837 Dec 17 12:39:20.641136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 166/345] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:20 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:20.904492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:20.905488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:20.915823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.916748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:20.918213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:20.918667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:21.050314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:21.057664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-24785d52-343b-421a-9c00-26a0cac3fbdc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.159414 Dec 17 12:39:21.058227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 167/346] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:21.330716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:21.331769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:21.341515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:21.341956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:21.342720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:21.343142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:21.490446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:21.502756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9370eb9-acc6-4fc7-bb21-05893ff09c6d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.178207 Dec 17 12:39:21.503681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 168/347] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:21 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:21.657641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:21.658140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:21.664605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:21.665043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:21.666210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:21.666825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:21.799302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:21.807385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fdaabe4e-2476-4e08-ab94-74660c055514 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.153492 Dec 17 12:39:21.807956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 169/348] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:21 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:22.075435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:22.076080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:22.082838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.083307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:22.084124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.084571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:22.223062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:22.233308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-abcc003e-53f5-41f3-806c-656d8fa226a0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.161831 Dec 17 12:39:22.233948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 170/349] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:22.523393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:22.524430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:22.534754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.535536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:22.536798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.537544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:22.677592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-889bbbf4-f27a-47bc-bf81-7dc827ccc872 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 3.837806 Dec 17 12:39:22.678248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 180/350] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:18 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 3839 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:22.681817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:22.689234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-79e549a6-a01c-4f23-a89e-98e9037fa5be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.171999 Dec 17 12:39:22.690160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 171/351] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:22 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:22.825403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:22.826569 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:22.834054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.834950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:22.835447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:22.835934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.033653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:23.040949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-71d4926c-d408-4ca1-802f-0dea54d24bf5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.219699 Dec 17 12:39:23.041741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 181/352] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:22 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:23.249965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:23.250542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:23.256552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.257002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.257803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.258234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.276097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-41c7d0be-f3b5-4bfa-a167-59c2a1ab653b req-7373662a-ce30-4aba-9e2d-c7dff426549f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1ede74-0deb-4b88-af72-a692da9b71ed", "tag": "b39bee7e-4475-4ebd-8738-43161ffc22d9"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:23.277795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:23.277795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:39:23.285415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-41c7d0be-f3b5-4bfa-a167-59c2a1ab653b req-7373662a-ce30-4aba-9e2d-c7dff426549f service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.285992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-41c7d0be-f3b5-4bfa-a167-59c2a1ab653b req-7373662a-ce30-4aba-9e2d-c7dff426549f service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.302433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-41c7d0be-f3b5-4bfa-a167-59c2a1ab653b req-7373662a-ce30-4aba-9e2d-c7dff426549f service nova] Creating event network-changed:b39bee7e-4475-4ebd-8738-43161ffc22d9 for instance 3e1ede74-0deb-4b88-af72-a692da9b71ed on hv-cinder-80152 Dec 17 12:39:23.307359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-41c7d0be-f3b5-4bfa-a167-59c2a1ab653b req-7373662a-ce30-4aba-9e2d-c7dff426549f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034883 Dec 17 12:39:23.307962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 182/353] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:23.388911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:23.396884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fbed18ea-0d46-4382-b065-b45a476cafcd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.150788 Dec 17 12:39:23.397505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 172/354] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:23.690838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:23.691872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:23.698317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.698755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.701532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.701965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.706338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:23.707484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:23.714009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.714574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.715592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:23.716024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:23.810004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5611a578-85f7-46ab-a1bf-72a5984a8cc4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.123624 Dec 17 12:39:23.810781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 183/355] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:23 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:23.865479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:23.873084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0142ce4e-ced4-4145-87d0-266320912c1d tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1318 microversion: 2.1 time: 0.170607 Dec 17 12:39:23.873682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 173/356] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:23 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:24.058199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:24.058983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:24.066186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.066642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.067406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.067866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.412783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:24.413426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:24.419478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.419919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.420682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.421106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.520266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:24.528808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba69910e-db6c-4101-b266-18b0eedccd4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.474679 Dec 17 12:39:24.529407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 184/357] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:24 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:24.562841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:24.570318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bef1ccb6-83b6-46af-8ec2-e949bd67379f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.161285 Dec 17 12:39:24.570895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 174/358] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:24 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:24.821093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:24.822739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:24.830593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.831025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.831825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.832259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.889660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:24.890481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:24.897256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.897768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:24.898745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:24.899244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:25.035293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:25.043014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac8db171-0591-4c31-85f0-208456de22f8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1508 microversion: 2.1 time: 0.157090 Dec 17 12:39:25.043599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 175/359] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:24 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:25.549520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:25.550821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:25.560211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:25.560651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:25.561456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:25.561876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:25.702137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:25.709939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-54acb8ba-4731-4597-a4bc-4c34972fcd1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.166736 Dec 17 12:39:25.710516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 176/360] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:25 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:25.717025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:25.717771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:25.723664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:25.724217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:25.724981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:25.725434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:25.856704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:25.867578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aa284a49-7207-4dd5-b450-924ccdf664a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.153719 Dec 17 12:39:25.868316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 177/361] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:26.726621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:26.727218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:26.734428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:26.734870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:26.735641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:26.736070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:26.868979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:26.876488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-39a0dc60-3d0b-4794-a2f5-567c4ec46e78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.153690 Dec 17 12:39:26.877068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 178/362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:26 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:26.883152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:26.883761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:26.890872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:26.891587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:26.892758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:26.893427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:27.045772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:27.053361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99ebed78-3286-44af-ac7e-9022956cebb1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.173459 Dec 17 12:39:27.053897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:27.897418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:27.898516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:27.907448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:27.907921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:27.908677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:27.909113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:28.042794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:28.055009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c008eec2-cc4c-4588-ae01-165eb9800ced tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.163579 Dec 17 12:39:28.055939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 180/364] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:27 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:28.071537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:28.072137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:28.078290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:28.078692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:28.079443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:28.080038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:28.210249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:28.217512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25b946cc-9b63-421d-9367-f8eb7eb0ee24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.149500 Dec 17 12:39:28.218078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 181/365] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:28 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:29.074195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:29.074748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:29.081698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:29.082138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:29.082903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:29.083328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:29.220687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:29.228461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5caee1ce-7655-4de8-8d72-f32cfdb0bc53 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.158020 Dec 17 12:39:29.229191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 182/366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:29 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:29.233471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:29.234059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:29.239966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:29.240407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:29.241173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:29.241631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:29.371606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:29.379308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0c3140e-a1ec-4128-9e3f-8220935e7d4a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.149153 Dec 17 12:39:29.379894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:29.539482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-851aa876-c51d-4e4a-9dc6-70844ffd2084 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 4.721840 Dec 17 12:39:29.540109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 185/368] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:24 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 4723 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:30.248886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:30.249633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:30.257539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.258102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.259046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.259616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.394866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:30.396830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:30.397974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:30.402901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-46aa71f1-f52f-4b3e-a94c-90a1bed45fa6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.160192 Dec 17 12:39:30.403481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 184/369] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:30 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:30.406015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.406468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.407266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.407701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.542218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:30.552448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:30.553505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:30.559648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.560034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a1de6982-baa6-4584-b590-f2c0a76305ab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.166880 Dec 17 12:39:30.560151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.560881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:30.561333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:30.566115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 186/370] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:30.642762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0de0067-7b5d-4f26-88a4-aaee9fcd3e56 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.094754 Dec 17 12:39:30.643596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 185/371] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:30 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:31.420497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:31.421043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:31.427833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.428340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.429073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.429540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.566946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:31.577014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:31.577926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:31.578755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-71dc97cc-f28a-4b42-9af4-2f0661c43878 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.162027 Dec 17 12:39:31.584078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 187/372] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:31 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:31.584817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.585437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.586270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.586705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.617714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a239ac0-fbef-4401-aaa8-7d0e50fe7f05"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:31.618963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:31.625551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.626003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.626797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.627231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.725447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:31.733041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1004a52d-8766-4216-b0bc-3d58e494b8b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.160751 Dec 17 12:39:31.742050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 186/373] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:31.746907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:31.747899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:31.754305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.754742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.755521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:31.755941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:31.857998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ec68100c-3fa0-439a-a663-ef0f2c1e8b2c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.114370 Dec 17 12:39:31.858919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 187/374] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:31 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:31.900898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bbb9ad18-807f-4b8d-abaf-9ee1c0129be6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286927 Dec 17 12:39:31.904668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 188/375] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:39:31 2021] POST /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:39:32.600907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:32.601580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:32.608727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.609232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.610078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.610566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.749705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:32.751163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:32.755399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:32.757499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.757956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.758752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.759188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.763283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28002c95-efec-43c7-b306-c0a029961b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.166812 Dec 17 12:39:32.764031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 188/376] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:32 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:32.869008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:32.869945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:32.875897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.876310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.877110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:32.877526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:32.894492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:32.901823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-22bce431-ada9-44b0-9c6d-989780f31183 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.156864 Dec 17 12:39:32.902379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 189/377] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:32.963953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e14417c-96d8-42f8-bcde-89a5eb9f9146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.098408 Dec 17 12:39:32.964603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 189/378] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:32 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:33.780070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:33.780795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:33.787396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.787846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:33.788620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.789057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:33.919919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:33.920732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:33.920906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:33.928762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.928960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fef83a6a-543b-4d88-8805-4a25d0d96d97 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.152718 Dec 17 12:39:33.929564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:33.938196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 190/379] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:33 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:33.938367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.938367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:33.976134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:33.977136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:33.984577 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.985457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:33.986246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:33.986679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:34.067633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-93117b0a-1c96-467f-bf68-9e52d7f06eef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.095113 Dec 17 12:39:34.071949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 191/380] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:33 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:34.079093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:34.086586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dfd52c04-862c-4db5-ae34-4d742506871f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.171629 Dec 17 12:39:34.087153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 190/381] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:34.950605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:34.952045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:34.959638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:34.960103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:34.960918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:34.961400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:35.080082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:35.081010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:35.087683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:35.088132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:35.088919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:35.089376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:35.108784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:35.118239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-377bbdd7-72af-4cc9-a515-0edc697bc162 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.173763 Dec 17 12:39:35.118973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 192/382] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:34 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:35.129109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:35.129707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:35.135962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:35.136402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:35.137166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:35.137647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:35.215857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b830023e-411b-4918-9343-a02fd595118b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.139621 Dec 17 12:39:35.219742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 191/383] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:35 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:35.266683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:35.278064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20fd42d9-1661-4c82-ad1e-6abfc9a2f494 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.157841 Dec 17 12:39:35.278845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 193/384] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:36.138498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:36.139226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:36.148336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.148892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.150118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.150740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.227499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:36.228458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:36.235353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.235801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.236575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.237006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.285339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:36.296275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d8392030-1675-46d4-aed7-44e6e6a24721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.163599 Dec 17 12:39:36.297075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 192/385] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:36 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:36.301322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:36.301931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:36.307536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.308023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.308781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:36.309203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:36.453947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:36.461583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff3ebf43-f5cb-4e26-9d01-72f22e2658c5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.163545 Dec 17 12:39:36.462157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 193/386] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:37.316744 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:37.317798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:37.328131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:37.328569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:37.329334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:37.329794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:37.463794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:37.474097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5531c977-ffbc-4bc5-a058-27e4f42c97ad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.163138 Dec 17 12:39:37.474873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 194/387] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:37 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:37.479091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:37.479673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:37.485941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:37.486371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:37.487127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:37.487548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:37.615321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:37.623526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a11ce733-49d8-4256-aa29-4351429642fd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.147664 Dec 17 12:39:37.624124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 195/388] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:37 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:38.494874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:38.495899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:38.503563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:38.503940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:38.504703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:38.505125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:38.653000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:38.660788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe966a15-41cd-477e-9846-cb8095ed7954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.172303 Dec 17 12:39:38.661412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 196/389] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:38 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:38.665613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:38.666233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:38.672539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:38.672979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:38.673762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:38.674186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:38.807819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:38.819544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e34cbae4-ec97-4a67-994f-358f7aced533 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.157029 Dec 17 12:39:38.820279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 197/390] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:38.924826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d70142cc-0c53-404c-8551-b361367d4b80 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 2.700826 Dec 17 12:39:38.928993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 194/391] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:36 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 2703 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:39.336250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-3cef8d2d-4fa1-4483-b393-1872119a6e3a req-9e74d0ed-0b3a-4989-a983-a6dba10b3a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1ede74-0deb-4b88-af72-a692da9b71ed", "name": "network-vif-plugged", "status": "completed", "tag": "b39bee7e-4475-4ebd-8738-43161ffc22d9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:39.338103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:39.338103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:39:39.346318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3cef8d2d-4fa1-4483-b393-1872119a6e3a req-9e74d0ed-0b3a-4989-a983-a6dba10b3a4c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.346810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3cef8d2d-4fa1-4483-b393-1872119a6e3a req-9e74d0ed-0b3a-4989-a983-a6dba10b3a4c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.358619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-3cef8d2d-4fa1-4483-b393-1872119a6e3a req-9e74d0ed-0b3a-4989-a983-a6dba10b3a4c service nova] Creating event network-vif-plugged:b39bee7e-4475-4ebd-8738-43161ffc22d9 for instance 3e1ede74-0deb-4b88-af72-a692da9b71ed on hv-cinder-80152 Dec 17 12:39:39.363669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-3cef8d2d-4fa1-4483-b393-1872119a6e3a req-9e74d0ed-0b3a-4989-a983-a6dba10b3a4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032315 Dec 17 12:39:39.364452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 198/392] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:39.677882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:39.678569 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:39.685744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.686175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.686961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.687400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.837557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:39.838405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:39.843433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:39.846427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.846887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.847676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.848106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.853248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c6513d31-738a-4c86-8c8e-8ee35edeb374 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.179184 Dec 17 12:39:39.854341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 195/393] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:39 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:39.943523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:39.946390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:39.955435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.956181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:39.957613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:39.958306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:40.003458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:40.014269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-daecf7b7-283a-4a7f-8219-9ac0449caba9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.181845 Dec 17 12:39:40.017667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 199/394] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:40.035667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bfe7408b-a817-4974-9675-6d2eacfe7001 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.103067 Dec 17 12:39:40.036314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 196/395] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:39 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:40.873645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:40.874676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:40.885326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:40.886088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:40.887374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:40.888097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.023123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:41.030936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:41.031447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-604a7ee8-7ca8-45ad-b674-86c3b19ee094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.163903 Dec 17 12:39:41.031557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 200/396] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:40 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:41.031647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:41.039199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.039625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.040407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.040891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.047323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:41.048287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:41.054176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.054628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.055408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.055964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.129333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e124f7e5-aa47-4f52-b307-4e59357523b0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.085204 Dec 17 12:39:41.133632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 201/397] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:41 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:41.184887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:41.192317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8b9b102-c16b-431b-b767-f3d878ac2505 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1319 microversion: 2.1 time: 0.165403 Dec 17 12:39:41.192888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 197/398] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:41.513627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a239ac0-fbef-4401-aaa8-7d0e50fe7f05"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:41.514785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:41.521948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.522393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.523177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.523609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.602100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Invalid volume: volume 3a239ac0-fbef-4401-aaa8-7d0e50fe7f05 is already attached to instances: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a Dec 17 12:39:41.602691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 400 to user: Invalid volume: volume 3a239ac0-fbef-4401-aaa8-7d0e50fe7f05 is already attached to instances: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:39:41.603524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4b3a68b6-9d59-4e8d-a1c8-fb374ea7eab6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094339 Dec 17 12:39:41.604091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 202/399] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:39:41 2021] POST /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:39:41.663091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:41.663590 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:41.670229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.670680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.671456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.671898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.799396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lazy-loading 'services' on Instance uuid 0ba020eb-5d3a-4c81-a3d6-82feee675c3a {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:39:41.918661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ea537ff0-2a40-450d-825b-f38691b891df tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments/3a239ac0-fbef-4401-aaa8-7d0e50fe7f05" status: 202 len: 0 microversion: 2.1 time: 0.259154 Dec 17 12:39:41.919268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 198/400] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:39:41 2021] DELETE /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments/3a239ac0-fbef-4401-aaa8-7d0e50fe7f05 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:41.928373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:41.929389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:41.938395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.938843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.939633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:41.940681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:41.973296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-030c6cb8-baf4-41c8-a550-12241368f172 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049356 Dec 17 12:39:41.973896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 203/401] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:39:41 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:39:42.049199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:42.049934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:42.056996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.057544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.058335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.058777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.141432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:42.142363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:42.149164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.149623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.150443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.150877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.190517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:42.197986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5accc804-5872-47aa-a9ca-e539e3807802 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.153452 Dec 17 12:39:42.198560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 199/402] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:42 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:42.208974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:42.209595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:42.215279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.215726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.216502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.216939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.226735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5f5bd814-3992-41b8-b424-02a820ff98ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.089090 Dec 17 12:39:42.227396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 204/403] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:42 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:42.350627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:42.358006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9fc893e5-7830-44e4-be8c-c1a6e9551235 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1508 microversion: 2.1 time: 0.152396 Dec 17 12:39:42.358582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 200/404] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:42.984772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:42.985873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:42.992590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.993087 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:42.993905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:42.994331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:43.026527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff4faafa-2431-4aad-985f-75beb9422e0a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Dec 17 12:39:43.027051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 205/405] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:39:42 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:43.215810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:43.216399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:43.223048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:43.223462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:43.224235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:43.224681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:43.238811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:43.239770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:43.247193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:43.247894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:43.249025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:43.249779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:43.357894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cf1a7cfd-2044-4334-aed2-270da478e1e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.122574 Dec 17 12:39:43.358516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 206/406] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:43 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:39:43.368001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:43.375602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c52f0005-d9a8-4fbe-9b36-25ea962ef318 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.163902 Dec 17 12:39:43.376372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 201/407] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:43 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:44.043663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:44.043663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:44.049948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.050607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.051645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.052247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.082655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cff6eca2-4024-48de-b65e-81cfd3434d5e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047408 Dec 17 12:39:44.083526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 207/408] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:39:44 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:39:44.234897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1722486217", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "1738f8ac-3144-4a29-8c86-ab024ec61052"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:44.291264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] validate_networks() for [('1738f8ac-3144-4a29-8c86-ab024ec61052', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:39:44.370452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:44.371838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:44.378628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.379156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.379952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.380384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.467779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-018cdd11-7650-4218-ac11-8fca15922b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.101272 Dec 17 12:39:44.470063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 208/409] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:44 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:44.475450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:44.476134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:44.483272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.483712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.484491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.484916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.630039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:44.638489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d8f6835-96c1-4cb5-8d0f-d66d4093bb49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1521 microversion: 2.1 time: 0.166992 Dec 17 12:39:44.639121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:44 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:44.679020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:39:44.679632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:39:44.680279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:39:44.680732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:39:44.681319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:39:44.693223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.693723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.694508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:44.695226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:44.711900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:39:44.716459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Getting quotas for user 45f9bd776357421f97fb8530da002ef0 and project d1d752190b174dc08eb973b3c2c800ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:39:44.728343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:39:44.730673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:39:44.782069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-287666fd-3aba-473c-816c-181debe28c45 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553289 Dec 17 12:39:44.782700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 202/411] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:39:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:39:44.793646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ae4cd849-9159-4409-9f02-2877ed6b8043 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:44.794605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ae4cd849-9159-4409-9f02-2877ed6b8043 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:44.850015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ae4cd849-9159-4409-9f02-2877ed6b8043 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:44.857799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ae4cd849-9159-4409-9f02-2877ed6b8043 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1218 microversion: 2.1 time: 0.068953 Dec 17 12:39:44.858605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 210/412] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:44 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:45.479993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:45.480959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:45.487037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.487487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.488278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.488690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.581263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d3ea959a-e564-490e-ac61-463f7e910ccf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.105054 Dec 17 12:39:45.582245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 203/413] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:45 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:45.660239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:45.660916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:45.667467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.667917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.668713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.669152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.845567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:45.853406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b99d202f-3d81-4566-af54-b76e5e53cbe1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1501 microversion: 2.1 time: 0.197009 Dec 17 12:39:45.854344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 211/414] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:45 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:45.874844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:45.875460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:45.878263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:45.879300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:45.881888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.882522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.883827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.885707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.886940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.887566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.888518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:45.891028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:45.963101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:45.972147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ccc4545-8ad2-4b46-a382-f8efd8ff4efa tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1278 microversion: 2.1 time: 0.100965 Dec 17 12:39:45.986270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 212/415] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:45 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:46.144766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:46.152709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1d55ce07-1b1f-4139-bd00-72b82ef572af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1514 microversion: 2.1 time: 0.286659 Dec 17 12:39:46.153499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 204/416] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:46.595346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:46.596265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:46.602290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:46.603010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:46.604002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:46.604670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:46.711304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-68206775-3d5d-46bd-a05e-898808870040 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.119967 Dec 17 12:39:46.711980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 213/417] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:46 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:46.999026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:47.001064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:47.020551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.022239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.024214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.024680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.277466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:47.285243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66f73a88-97b4-430c-b3a3-dabfbb731623 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.297333 Dec 17 12:39:47.285956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 205/418] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:46 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:47.441144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-770282d2-de9d-4509-8207-36569f1278d0 req-76b4442d-a1e8-42ca-a5e9-ed2de48f09e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927a436f-dc39-4c21-8e02-0b18e32cb477", "tag": "906dec4b-7145-48aa-90d7-5451b1bd9324"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:47.442926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:47.442926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:39:47.452180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-770282d2-de9d-4509-8207-36569f1278d0 req-76b4442d-a1e8-42ca-a5e9-ed2de48f09e1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.452736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-770282d2-de9d-4509-8207-36569f1278d0 req-76b4442d-a1e8-42ca-a5e9-ed2de48f09e1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.475312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-770282d2-de9d-4509-8207-36569f1278d0 req-76b4442d-a1e8-42ca-a5e9-ed2de48f09e1 service nova] Creating event network-changed:906dec4b-7145-48aa-90d7-5451b1bd9324 for instance 927a436f-dc39-4c21-8e02-0b18e32cb477 on hv-cinder-80152 Dec 17 12:39:47.481783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-770282d2-de9d-4509-8207-36569f1278d0 req-76b4442d-a1e8-42ca-a5e9-ed2de48f09e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046262 Dec 17 12:39:47.483110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 214/419] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:47.530139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:47.531265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:47.538983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.539446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.540324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.540693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.564111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lazy-loading 'flavor' on Instance uuid 21d1af76-68e9-4515-8374-ecae895e7c09 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:39:47.647745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-05573b64-3a32-4387-baf0-5301b537f3d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action" status: 200 len: 32 microversion: 2.1 time: 0.121694 Dec 17 12:39:47.648392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 206/420] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:39:47 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action => generated 32 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:39:47.658510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:47.659204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:47.665297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.665952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.666897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.667481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.725248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:47.726378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:47.735682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.736377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:47.737524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:47.738123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:48.012212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cfa21f14-2714-4fb5-bcb9-5a8d81f4c169 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.291678 Dec 17 12:39:48.017506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 207/421] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:47 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:48.196157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:48.204570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f5315a2-1f0f-4c86-99bb-5c8ee8e458dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.550415 Dec 17 12:39:48.205356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 215/422] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:48.302536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:48.303576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:48.311108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:48.311800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:48.312985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:48.313698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:48.549456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:48.558093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b93c4522-88b0-4272-af08-062865c78b33 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.259504 Dec 17 12:39:48.558807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 208/423] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:48 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:49.024952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:49.026007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:49.032338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.032790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.033640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.034706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.221750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:49.223028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:49.229965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.230419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.231221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.231664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.298194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-242db76d-0fc1-4f87-856c-9473b141699c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.277414 Dec 17 12:39:49.299506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 216/424] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:49 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:49.415986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:49.425224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-63d23b56-318a-4d47-81b1-164140dee4f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.206670 Dec 17 12:39:49.425997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 209/425] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:49.575949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:49.577013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:49.588251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.588657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.589705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:49.590136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:49.744107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:49.752560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d6d7e019-fa7c-44cf-8bb2-7e2ce091cbe3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.180894 Dec 17 12:39:49.753248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 217/426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:49 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:50.311078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:50.312313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:50.318951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.319515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:50.320372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.320803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:50.407035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bcd919fb-3666-490c-8522-ce300b843822 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.099479 Dec 17 12:39:50.407663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 210/427] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:50 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:50.442781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:50.443348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:50.449769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.450196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:50.451548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.452136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:50.594228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:50.604817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0880cd66-9789-4f4a-b0cf-dc07eeb323fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.165902 Dec 17 12:39:50.605735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 218/428] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:50.772615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:50.773634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:50.781019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.782102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:50.783068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:50.783643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:51.010721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:51.019078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0b39b895-a33f-4f33-94f7-d3cf2fbc51be tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.253593 Dec 17 12:39:51.022808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 211/429] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:50 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:51.418742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:51.419901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:51.426609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:51.427368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:51.428252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:51.428898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:51.514868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-24a29615-2a4f-4cd3-9c89-fd6579b9754a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.099549 Dec 17 12:39:51.515526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 219/430] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:51 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:51.622826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:51.623647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:51.630431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:51.630962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:51.632029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:51.632743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:51.799156 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:51.812872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6cd9ad39-8bde-488e-938b-8d58bdd20831 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.193654 Dec 17 12:39:51.813888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 212/431] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:52.037008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:52.038165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:52.080231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.083202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:52.084508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.084963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:52.319054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:52.327253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-05380e82-caf4-49b5-af1d-c99267bce870 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.294971 Dec 17 12:39:52.328168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 220/432] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:52 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:52.526205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:52.527303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:52.535166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.535686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:52.536588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.537122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:52.617819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6042a6bf-e565-41d0-9701-e05f8b2c3438 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.091481 Dec 17 12:39:52.619269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 213/433] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:52 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:52.832695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:52.834553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:52.844752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.845682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:52.846746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:52.847518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:53.017684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:53.025437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d00ada7b-74ec-4e18-89a8-01f204646de4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.197302 Dec 17 12:39:53.026014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 221/434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:53.346515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:53.347216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:53.354420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:53.354854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:53.355646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:53.356077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:53.525036 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:53.539070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-36376cb6-5f09-4528-b660-6d6b779e163f tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.197994 Dec 17 12:39:53.540066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 214/435] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:53 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:53.630366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:53.633471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:53.640566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:53.641124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:53.642092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:53.642547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:53.800442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5f6a6608-0b68-4962-8331-bc9bef13772f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.173864 Dec 17 12:39:53.804410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 222/436] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:53 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:54.043329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:54.044611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:54.051573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.052374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.053894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.054478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.233365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:54.241919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9e8c7164-fa43-441d-83ce-294d7d36d898 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.202826 Dec 17 12:39:54.243302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 215/437] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:39:54.559027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:54.561718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:54.572904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.573656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.575051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.575687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.813961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:54.815020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:54.823793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.824445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.825418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:54.828539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:54.902886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de2b33d2-9e44-4032-952c-9d4a86ee0f72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.093906 Dec 17 12:39:54.904545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 216/438] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:54 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:55.217825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:55.228090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-26837ee6-29d6-469b-b344-f77e543db63b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.675455 Dec 17 12:39:55.229121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 223/439] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:54 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:55.261449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:55.263144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:55.276257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:55.277033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:55.278112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:55.278670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:55.443110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:55.453367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a17e34f8-b4c0-465e-a3ca-75e68fa64777 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.197765 Dec 17 12:39:55.463584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 217/440] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:55.917215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:55.918223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:55.928716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:55.929537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:55.930560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:55.931166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:56.029929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da5d85c0-80ab-405b-b127-21d02fa89ce4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.116968 Dec 17 12:39:56.034497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 224/441] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:55 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:56.246196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:56.246775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:56.253631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:56.254109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:56.255262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:56.256244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:56.431808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:56.447606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b185526a-3f52-465c-98a6-60d9a8e23a95 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.205462 Dec 17 12:39:56.448783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 218/442] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:56 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:56.484344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:56.485133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:56.495390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:56.496586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:56.500318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:56.501027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:56.926533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:56.937715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d42240c1-bce2-44f5-9e34-fe990de70a47 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.470385 Dec 17 12:39:56.957649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 225/443] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:57.042091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:57.043279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:57.050672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.051124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.051917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.052345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.137496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6adb2d05-fdfb-4d8f-8b64-58bec90335c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.099060 Dec 17 12:39:57.138732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 219/444] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:57 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:57.465265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:57.465883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:57.505058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.507773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.510225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.510680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.750979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:57.760417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7e0c93b-4416-4205-8a14-93692a537534 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.299701 Dec 17 12:39:57.776442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 226/445] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:57 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:57.892928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-a42dab4f-9c36-4987-8e99-ec37577e9092 req-1886a039-f86c-4a2b-8a18-36df20dc5fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927a436f-dc39-4c21-8e02-0b18e32cb477", "name": "network-vif-plugged", "status": "completed", "tag": "906dec4b-7145-48aa-90d7-5451b1bd9324"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:57.894748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:39:57.894748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:39:57.911165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a42dab4f-9c36-4987-8e99-ec37577e9092 req-1886a039-f86c-4a2b-8a18-36df20dc5fe4 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.911611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a42dab4f-9c36-4987-8e99-ec37577e9092 req-1886a039-f86c-4a2b-8a18-36df20dc5fe4 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.936508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-a42dab4f-9c36-4987-8e99-ec37577e9092 req-1886a039-f86c-4a2b-8a18-36df20dc5fe4 service nova] Creating event network-vif-plugged:906dec4b-7145-48aa-90d7-5451b1bd9324 for instance 927a436f-dc39-4c21-8e02-0b18e32cb477 on hv-cinder-80152 Dec 17 12:39:57.956369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-a42dab4f-9c36-4987-8e99-ec37577e9092 req-1886a039-f86c-4a2b-8a18-36df20dc5fe4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067451 Dec 17 12:39:57.956613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:57.957058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:57.963657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 220/446] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:39:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:39:57.967265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.968048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:57.969390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:57.969977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:58.151353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:58.153019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:58.165979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:58.166609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:58.167521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:58.168115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:58.240078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b07fb464-b802-4cfb-9d60-66044fc4c708 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.094256 Dec 17 12:39:58.245550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 221/447] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:58 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:58.351469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:58.359484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-556c6ddf-141c-4fa1-a6fa-970cdecbd5a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.408439 Dec 17 12:39:58.369073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 227/448] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:58.782517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:58.783206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:58.790703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:58.791380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:58.792320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:58.792896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:59.001700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:59.011140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0694b000-a761-456e-a8f9-04b0de4fc215 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.233226 Dec 17 12:39:59.011719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 222/449] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:58 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:39:59.252933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:39:59.253983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:59.271346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:59.271804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:59.272615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:59.273051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:59.366824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-71ac4f13-2ddb-4d3b-bf8d-8765e1267341 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.118088 Dec 17 12:39:59.367609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 228/450] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:39:59 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:39:59.376904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:39:59.377713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:39:59.384897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:59.385493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:59.386476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:39:59.387063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:39:59.520882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:39:59.529164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8eadaf94-917e-444c-9a0e-19822bed9289 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.156430 Dec 17 12:39:59.529734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 223/451] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:39:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:00.032611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:00.033310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:00.040955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.041576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.042356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.042781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.237688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:00.245801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ec5317d-0e3a-4d13-ba57-dc3753e3dc56 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1318 microversion: 2.1 time: 0.218995 Dec 17 12:40:00.247013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 229/452] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:00 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:00.422714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:00.424439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:00.440754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.441253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.442188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.442925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.546579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:00.547882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:00.556610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.557061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.561889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:00.562330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:00.609682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0b34ecfb-af69-4430-8961-451e368bb5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.194666 Dec 17 12:40:00.610657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 224/453] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:00 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:00.725810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:00.739567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-350709a0-22c7-4a8a-a7b5-cf8f0b3a15b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.196214 Dec 17 12:40:00.757455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 230/454] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:40:01.263434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:01.264381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:01.280801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.281396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:01.282326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.282761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:01.495884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:01.524353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-33f14ac5-27f4-43e5-a16b-97d5104f25ad tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1509 microversion: 2.1 time: 0.263770 Dec 17 12:40:01.535375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 225/455] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:01 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:01.622981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:01.624186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:01.637781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.638147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:01.638942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.647228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:01.765382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:01.765650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bdc77c64-18f5-465a-914f-fcdcc9cbde09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.147834 Dec 17 12:40:01.769608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 231/456] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:01 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:01.769777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:01.776965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.777762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:01.779392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:01.780341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:02.028907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:02.038686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4270f5ea-4947-4105-9c30-9faa31b2ace8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.281959 Dec 17 12:40:02.049189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 226/457] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:40:02.778273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:02.779288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:02.790555 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:02.791372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:02.792400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:02.793173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:03.025635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23452892-4690-4153-8ce2-3b980b603b1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.251186 Dec 17 12:40:03.026599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 232/458] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:02 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:03.057071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:03.057071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:03.063667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:03.064114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:03.064900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:03.065352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:03.224785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:03.235107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d419cbc-8405-4e3a-8d33-e5c1efc9b847 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.182758 Dec 17 12:40:03.236188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 227/459] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:40:04.039743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:04.041032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:04.052421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.052872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.053695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.055240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.085601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "447f5dea-9786-4ea1-a618-b8530d7287b5"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:04.086647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:04.097466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.097937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.098733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.099280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.151895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dbe0f5d6-7e67-4ca3-9f5a-886a6a11d4aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.116856 Dec 17 12:40:04.153389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 233/460] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:04 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:04.254393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:04.255084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:04.265481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.266213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.267702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:04.268291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:04.424141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-900f57c6-50a3-4c4f-9dc5-29112db96ae9 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "POST /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341030 Dec 17 12:40:04.425478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 228/461] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:40:04 2021] POST /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:04.462721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:04.472408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1c5fc9c-3d79-40d9-ac5e-1d031a233fa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1520 microversion: 2.1 time: 0.222229 Dec 17 12:40:04.473250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 234/462] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:40:05.167930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:05.169128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:05.175738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.176450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.177465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.177903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.260319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-31c3d8b8-3454-4d95-bf51-ece6dec47ee0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.099432 Dec 17 12:40:05.265305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 229/463] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:05 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:05.491391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:05.492082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:05.498468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.499197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.500242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.500911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.697028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:05.705468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-68960254-bab3-47d2-abad-61b147b31ec8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1500 microversion: 2.1 time: 0.219036 Dec 17 12:40:05.706169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 235/464] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1500 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:05.723231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91cdad79-bd5e-4021-90cd-2483a464180f"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:05.724398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:05.732544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.733025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.733857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.734298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.759834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] HTTP exception thrown: Cannot 'attach_volume' instance 21d1af76-68e9-4515-8374-ecae895e7c09 while it is in vm_state rescued Dec 17 12:40:05.760346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Returning 409 to user: Cannot 'attach_volume' instance 21d1af76-68e9-4515-8374-ecae895e7c09 while it is in vm_state rescued {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:40:05.761191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-81eee5ee-433b-42b7-92a4-dc21dd08ac5b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042539 Dec 17 12:40:05.761795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 230/465] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:40:05 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 17 12:40:05.770823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:05.771225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:05.780350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.780350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.780350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.780350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.916533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c8178ab-1a44-42e5-8e0e-e267fce53d58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action" status: 202 len: 0 microversion: 2.1 time: 0.149570 Dec 17 12:40:05.920270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 236/466] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:40:05 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:05.925774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:05.926447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:05.933661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.934115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:05.934912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:05.935333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:06.096901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:06.107056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-28eb261f-12d8-4262-9101-9e7c7081c5fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1508 microversion: 2.1 time: 0.185257 Dec 17 12:40:06.116389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 231/467] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:06.273105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:06.274058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:06.284954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:06.286026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:06.286850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:06.287285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:06.360157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2d752df6-d540-49ae-a50d-3949aa054bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.089649 Dec 17 12:40:06.361497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 237/468] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:06 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:07.124085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:07.124742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:07.133707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:07.134248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:07.135119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:07.135626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:07.298617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:07.306202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-06732e80-beb8-4089-9734-516e52cf639a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1508 microversion: 2.1 time: 0.185971 Dec 17 12:40:07.306774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 232/469] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:07.374491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:07.375761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:07.382896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:07.383340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:07.384128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:07.384557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:07.465502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-240ed542-dab4-4f41-8c78-87030eacf303 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28732 microversion: 2.20 time: 0.094987 Dec 17 12:40:07.466709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 238/470] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:07 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28732 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:08.323584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:08.324214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:08.331437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:08.332455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:08.333250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:08.333720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:08.469980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:08.478809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-494e556f-3807-4ab4-bdd6-8f5584164ccf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1508 microversion: 2.1 time: 0.159157 Dec 17 12:40:08.479613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 233/471] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:08.486857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:08.487902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:08.497556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:08.497996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:08.498810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:08.499212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:08.593838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-891cc0ac-03ec-4e53-802c-5149141ee02e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 28893 microversion: 2.20 time: 0.118834 Dec 17 12:40:08.594672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 239/472] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:08 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 28893 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:09.231723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Action: 'create', calling method: .version_select at 0x7fba11f3ab80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2045204590"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:09.252014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:40:09.256369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for user 242130414eea4adf864436aea5163cab and project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:40:09.355084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:40:09.359550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for user 242130414eea4adf864436aea5163cab and project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:40:09.373540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5c291c13-dbe9-4f98-b29c-bc028aa5adb8 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.145442 Dec 17 12:40:09.374164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 234/473] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Dec 17 12:40:09 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:09.428596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1562987191", "imageRef": "9353be61-b11f-4718-9e85-a713eefeb8d4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2045204590", "networks": [{"uuid": "dbf3b8ed-955f-43ce-97d9-3552383cc2a9"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:09.486747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] validate_networks() for [('dbf3b8ed-955f-43ce-97d9-3552383cc2a9', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:40:09.495653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:09.496284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:09.502488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.502952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.503771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.504233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.635148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:09.643426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4b3287a3-3bbb-482a-9573-1ff451b21f87 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1508 microversion: 2.1 time: 0.151334 Dec 17 12:40:09.644221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 235/474] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:40:09.648653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:09.649637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:09.655401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.655849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.656605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.657095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.756990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-64a01b4d-b156-4880-918c-8273bf07a4c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 30057 microversion: 2.20 time: 0.111504 Dec 17 12:40:09.757687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 236/475] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:09 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 30057 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:09.858883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:40:09.859423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:40:09.859762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:40:09.860220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:40:09.860625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:40:09.870161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.870646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.871445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:09.871890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:09.888461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:40:09.892945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Getting quotas for user 242130414eea4adf864436aea5163cab and project 6a3ff81cb1bd407ea1a6e88feb49a428. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:40:09.904752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:40:09.907043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9353be61-b11f-4718-9e85-a713eefeb8d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:40:09.956426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2926c3bd-2c16-4b40-9318-535dc2cc5a73 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534672 Dec 17 12:40:09.957311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 240/476] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 12:40:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 12:40:09.967391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-caed1d19-72ab-4f9e-a6ba-714b27328d96 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:09.968196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-caed1d19-72ab-4f9e-a6ba-714b27328d96 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:10.024942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-caed1d19-72ab-4f9e-a6ba-714b27328d96 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:10.031572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-caed1d19-72ab-4f9e-a6ba-714b27328d96 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1259 microversion: 2.1 time: 0.068207 Dec 17 12:40:10.032146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 237/477] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:09 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:10.366190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4044081-efbf-4921-ba73-b4fe7c75dd04", "device": "/dev/sdb"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:10.367973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:10.375713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.376134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.376909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.377356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.391826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:40:10.394174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:40:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed/os-volume_attachments (ip 10.222.0.45) !!! Dec 17 12:40:10.648880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-477fdca2-401c-4264-a8e7-9c874f2ac1fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "POST /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286823 Dec 17 12:40:10.650983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 241/478] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:40:10 2021] POST /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:10.659909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:10.660643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:10.667671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.673926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.674890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.675469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.769438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:10.770520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:10.776798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.777313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.778175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:10.778599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:10.820991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:10.829812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5ffd3013-a38e-4754-8710-a60b98c93f78 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1508 microversion: 2.1 time: 0.173208 Dec 17 12:40:10.835244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 238/479] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:11.035080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e7651f60-3201-4b61-802a-12a32af1e45b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 31121 microversion: 2.20 time: 0.270106 Dec 17 12:40:11.036807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 242/480] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:10 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 31121 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:40:11.048726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:11.049367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:11.055957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:11.056378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:11.057150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:11.057607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:11.120202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:11.128273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8f71faee-8af4-4475-883f-e4c865e623d6 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1311 microversion: 2.1 time: 0.084133 Dec 17 12:40:11.128840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 239/481] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:11 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:11.848384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:11.849077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:11.859402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:11.859859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:11.860762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:11.861905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.047935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:12.049544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:12.056700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.057185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.058342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.058974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.147905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:12.159178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c22edb02-c09d-43bb-a8b6-6edc2feae360 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1514 microversion: 2.1 time: 0.313949 Dec 17 12:40:12.160089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 243/482] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:12.173354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:12.174245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:12.186790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.189817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.191121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.191563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.306241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:12.317677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fa56b109-100f-48f1-a654-846219a97d0c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1317 microversion: 2.1 time: 0.155144 Dec 17 12:40:12.318262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 244/483] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:12 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:12.332166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:12.332969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:12.347557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.348027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.348840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.349316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.471103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lazy-loading 'services' on Instance uuid 927a436f-dc39-4c21-8e02-0b18e32cb477 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:40:12.595711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-36c3338c-971d-4729-87bc-e1f9bcebe401 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments/447f5dea-9786-4ea1-a618-b8530d7287b5" status: 202 len: 0 microversion: 2.1 time: 0.272702 Dec 17 12:40:12.596412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 245/484] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:40:12 2021] DELETE /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments/447f5dea-9786-4ea1-a618-b8530d7287b5 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:40:12.606423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:12.608006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:12.616501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.617377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.618433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:12.619893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:12.675967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-034c5030-d999-449c-98ec-2645ba841a2e tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074644 Dec 17 12:40:12.676547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 246/485] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:12 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:13.335344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:13.336047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:13.342680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:13.343879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:13.344800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:13.345233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:13.480891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:13.488433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-efc0243f-9bce-4a2d-b87c-5e84666369ce tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.156920 Dec 17 12:40:13.488993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 247/486] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:13 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:13.688475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:13.689838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:13.699354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:13.699796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:13.700577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:13.700998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:13.733639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d009f222-0451-4585-bf5a-4f2de4410524 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049210 Dec 17 12:40:13.734267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 248/487] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:13 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:14.505567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:14.506226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:14.512735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.513180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.513983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.514411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.648615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:14.657351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-657188af-e73a-4dca-8121-9dffa7171091 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.155502 Dec 17 12:40:14.657976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 249/488] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:14 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:14.745193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:14.746139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:14.752488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.752939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.753745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.754182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.784695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ca6cede-2df8-4b08-9b11-e12b9aea375b tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Dec 17 12:40:14.785264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 250/489] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:14 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:14.789500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:14.790084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:14.795742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.796173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.796929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.797382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.932270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:14.939956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b3611e6c-ae97-4aaa-8a16-7cc1786acf0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1514 microversion: 2.1 time: 0.153762 Dec 17 12:40:14.940525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 251/490] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:14.955914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4bf7a0-7e83-4fd4-bdea-23f367524cf3"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:14.957002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:14.964955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.965747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:14.967009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:14.967646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.184927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3a793b9d-4f4f-4200-9684-42f8c6aff12e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 200 len: 38414 microversion: 2.20 time: 21.140955 Dec 17 12:40:33.186528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 240/491] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:12 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 38414 bytes in 21144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:40:33.193555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:33.194332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:33.202515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.203019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.203920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.204530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.350924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:33.358166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ccfb4d34-3af5-4965-9d95-3e216cec265b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.405500 Dec 17 12:40:33.358757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d320ac4a-c326-4602-966a-622496413903 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.169449 Dec 17 12:40:33.359269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 241/492] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:33 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:33.364368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 252/493] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 12:40:14 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 194 bytes in 18413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:40:33.370710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:33.371850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:33.380061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.380526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.381629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.382227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.387503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:33.389213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:33.404284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.404866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.406069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.406603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e50c2185-c18c-464b-987e-8ee22ea362b4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/ips" status: 200 len: 152 microversion: 2.20 time: 0.040722 Dec 17 12:40:33.407220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.407838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 253/494] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Dec 17 12:40:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:40:33.443693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-48cf33e1-e0bb-4d1b-b0f6-7bf405b15877 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081253 Dec 17 12:40:33.444612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 242/495] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:33 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:33.727267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-5ba73861-4c4c-4dd8-9fc4-0843f0849ab0 req-5faf9500-9c1c-4095-9f80-ea0425f4ed2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd77a23-be90-4a51-8468-aa7608792be8", "tag": "f50ba2fb-dc38-4efa-9e99-b4670dcec0c5"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:33.729971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:40:33.729971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:40:33.748253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5ba73861-4c4c-4dd8-9fc4-0843f0849ab0 req-5faf9500-9c1c-4095-9f80-ea0425f4ed2b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:33.748743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-5ba73861-4c4c-4dd8-9fc4-0843f0849ab0 req-5faf9500-9c1c-4095-9f80-ea0425f4ed2b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:33.787717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-5ba73861-4c4c-4dd8-9fc4-0843f0849ab0 req-5faf9500-9c1c-4095-9f80-ea0425f4ed2b service nova] Creating event network-changed:f50ba2fb-dc38-4efa-9e99-b4670dcec0c5 for instance 7bd77a23-be90-4a51-8468-aa7608792be8 on hv-cinder-80152 Dec 17 12:40:33.794537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-5ba73861-4c4c-4dd8-9fc4-0843f0849ab0 req-5faf9500-9c1c-4095-9f80-ea0425f4ed2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071751 Dec 17 12:40:33.795150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 254/496] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:40:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:34.376063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:34.376681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:34.383156 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:34.383615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:34.384399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:34.384834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:34.456540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:34.458265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:34.465180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:34.465873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:34.466625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:34.467241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:34.496759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d3aafa0-9505-4aae-a385-d5b58551c8e3 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Dec 17 12:40:34.497346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 255/497] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:34 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:40:34.528491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:34.535932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-74b9c6d9-c1b3-48f9-a129-14c372c99e9e tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.164094 Dec 17 12:40:34.536509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 243/498] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:34 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:35.509435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:35.510675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:35.517393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.517832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.518917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.519007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.549583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e7638ffc-b940-4387-9e61-4c9256ca7866 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Dec 17 12:40:35.550161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 256/499] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:35 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:35.552538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:35.553213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:35.560189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.560301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.561179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.561647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.700147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:35.707762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59af2710-af37-43a7-9b34-fe0f7344895b tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.159601 Dec 17 12:40:35.708349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 244/500] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:35 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:35.816037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:35.816565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:35.823150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.823592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.824376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:35.824783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:35.849788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lazy-loading 'flavor' on Instance uuid 30ef64cd-7c51-44b7-917c-14ff209e0f81 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:40:36.171025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dcef8704-cfcc-4754-90c3-2820050d777c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 202 len: 0 microversion: 2.20 time: 0.358490 Dec 17 12:40:36.171860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 257/501] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:40:35 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:40:36.180280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:36.181239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:36.187795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.188297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.189103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.189607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.317818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:36.328084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:36.330329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:36.331420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61fcacb3-7e45-4bd6-bf1c-ed1fe2210c05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.154964 Dec 17 12:40:36.332508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 245/502] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:36.566675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:36.568511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:36.579641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.580536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.582040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.582762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.615758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4502321-6c0e-41e0-b9f6-32065e6478c0 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057005 Dec 17 12:40:36.616300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 258/503] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:36 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:36.728356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:36.729392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:36.739688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.740457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.741782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:36.742491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:36.880511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:36.888349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6b4be654-7dc3-41b3-8d33-8e1d394499e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.166111 Dec 17 12:40:36.888920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 246/504] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:36 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:37.353579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:37.354590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:37.364852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.365673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:37.366958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.367681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:37.504148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:37.512002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:37.513524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:37.514680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c43379d7-38c4-40f0-9a55-f201ab1b1e5e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.167346 Dec 17 12:40:37.515278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 259/505] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:37.628768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:37.629787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:37.637633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.638161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:37.638862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.639305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:37.681513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-232d85b2-c7c9-4495-9fec-8dd61ec83319 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057782 Dec 17 12:40:37.682063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 247/506] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:37 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:37.908751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:37.909609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:37.919654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.920105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:37.920882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:37.921305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:38.052911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:38.060375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-14c71e17-f226-464e-a09a-2c2c17c63eb1 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.157792 Dec 17 12:40:38.060922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 260/507] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:37 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:38.533008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:38.533699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:38.540330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:38.540806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:38.541654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:38.542090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:38.686276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:38.694273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:38.695052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:38.695768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:38.696233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:38.696926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-85f5b122-030e-4954-b310-e2e9ba5f655e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.167690 Dec 17 12:40:38.697523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 248/508] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:38.706300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:38.706750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:38.707542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:38.707972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:38.736999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-df765006-67da-41b9-8c82-e4dfa4b2c7b5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Dec 17 12:40:38.737595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 261/509] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:38 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:39.077820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:39.078432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:39.085182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.085672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.086453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.086890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.217809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:39.225094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-04b4435c-d8d6-4d53-ab2b-2395fc9c9c08 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.151460 Dec 17 12:40:39.225693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 249/510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:39 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:39.715673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:39.716234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:39.722929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.723371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.724155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.724592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.750103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:39.751654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:39.758588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.759046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.759792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:39.760426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:39.793503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7396bd34-a50e-4266-8297-47df7fc60a30 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Dec 17 12:40:39.794073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 250/511] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:39 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:39.859230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:39.866914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:39.868393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:39.869583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38980b50-b2d3-4f3d-b268-e13e2b369c69 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.157710 Dec 17 12:40:39.870142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 262/512] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:40.249305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:40.250753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:40.257085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.257536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:40.258370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.258741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:40.398553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:40.407902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3cac3a32-e6e2-4851-9b67-3eaf7439dd54 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.163191 Dec 17 12:40:40.417975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 251/513] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:40 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:40.810168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:40.811405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:40.819073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.820198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:40.821176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.821773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:40.851193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0032f24d-73fc-4fc1-8f5a-57708a33b2e5 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045646 Dec 17 12:40:40.851742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 263/514] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:40:40 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:40:40.887427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:40.888104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:40.894715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.895159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:40.895941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:40.896371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:41.028698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:41.036666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:41.038190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:41.039355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-922d2c6c-4a07-44de-b18e-4a2cf6c5e809 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.155761 Dec 17 12:40:41.039922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 252/515] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:40 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:41.429591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:41.430582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:41.440762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:41.441558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:41.442831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:41.443560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:41.576199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:41.584053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a5db27e-8cc7-4012-aa6e-88ba701d7ca3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.160702 Dec 17 12:40:41.584600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 264/516] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:41 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:42.057256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:42.057886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:42.064672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:42.065130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:42.065962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:42.066438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:42.200652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:42.208901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:42.210432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:42.211544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-12887b9c-7204-4828-8044-6c32e1b7418f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.158086 Dec 17 12:40:42.212103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 253/517] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:42.603017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:42.603950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:42.613886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:42.614571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:42.615740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:42.616443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:42.749313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:42.757033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d1c8ed9-c977-4c1b-9054-f0507e775ae3 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.159719 Dec 17 12:40:42.757623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 265/518] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:42 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:43.026873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-5c9946ca-250a-409c-ae49-72fc5341a015 req-f3a42a03-28e7-4c3b-802b-d2da1f0101dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd77a23-be90-4a51-8468-aa7608792be8", "name": "network-vif-plugged", "status": "completed", "tag": "f50ba2fb-dc38-4efa-9e99-b4670dcec0c5"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:43.028414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:40:43.028414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:40:43.036031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-5c9946ca-250a-409c-ae49-72fc5341a015 req-f3a42a03-28e7-4c3b-802b-d2da1f0101dc service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:43.036474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-5c9946ca-250a-409c-ae49-72fc5341a015 req-f3a42a03-28e7-4c3b-802b-d2da1f0101dc service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:43.048166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-5c9946ca-250a-409c-ae49-72fc5341a015 req-f3a42a03-28e7-4c3b-802b-d2da1f0101dc service nova] Creating event network-vif-plugged:f50ba2fb-dc38-4efa-9e99-b4670dcec0c5 for instance 7bd77a23-be90-4a51-8468-aa7608792be8 on hv-cinder-80152 Dec 17 12:40:43.053239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-5c9946ca-250a-409c-ae49-72fc5341a015 req-f3a42a03-28e7-4c3b-802b-d2da1f0101dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029994 Dec 17 12:40:43.053860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 254/519] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:43.233156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:43.234252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:43.244369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:43.245113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:43.246443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:43.247073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:43.394873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:43.403221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:43.404715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:43.405890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a00dd364-1f0b-4d7e-b2e8-769521a2ffb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.178884 Dec 17 12:40:43.406469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 266/520] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:43.779801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:43.781167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:43.791728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:43.792469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:43.794010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:43.794605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:43.926857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:43.935176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-db29d592-e321-4128-bbb8-61a1e073197a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.163070 Dec 17 12:40:43.935725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 255/521] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:43 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:44.427868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:44.428712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:44.439346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:44.440091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:44.441398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:44.442160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:44.578000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:44.586625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:44.588121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:44.589311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f3e83b75-dcd9-4219-9299-7b9a375f370e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.167825 Dec 17 12:40:44.589901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 267/522] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:44.961317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:44.962387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:44.970258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:44.970704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:44.971488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:44.971934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:45.106601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:45.114294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8b89426b-cdf4-4438-af7b-e862f1833d1a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.159183 Dec 17 12:40:45.114859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 256/523] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:44 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:45.611356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:45.612389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:45.622784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:45.623221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:45.623991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:45.624410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:45.794088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:45.802516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:45.804008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:45.805157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc9901fd-161c-43d6-ba0d-c4d9d1d95dba tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.200163 Dec 17 12:40:45.805765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 268/524] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:45 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:46.130776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:46.131550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:46.138303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:46.138828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:46.139670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:46.140185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:46.273134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:46.281659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-29e26342-8809-4e6e-b286-53059d864a58 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.154696 Dec 17 12:40:46.282222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 257/525] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:46 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:46.823041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:46.831157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:46.844074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:46.844726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:46.845735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:46.846285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:46.985140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:46.994298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:46.995768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:46.997061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-90263d51-87e9-49d5-8fd7-2c7b889e7af6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.177790 Dec 17 12:40:46.997782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 269/526] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:46 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:47.277879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:47.278397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:47.285179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.285667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.286457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.286890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.298192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:47.298881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:47.305345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.305818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.306615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.307024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.312504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:40:47.407906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d43a51a-876c-4505-a13a-71714e5fb0a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 204 len: 0 microversion: 2.1 time: 0.133406 Dec 17 12:40:47.408661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 258/527] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:40:47 2021] DELETE /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:40:47.416732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:47.417453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:47.423348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.423738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.424512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:47.424944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:47.440711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:47.447954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c229ccdd-0e53-40fa-9010-d957fe168eae tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.153501 Dec 17 12:40:47.448519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 270/528] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:47 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:47.552439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:47.565454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-23bde67f-6041-4e00-8e3c-b4a190218709 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1515 microversion: 2.1 time: 0.152201 Dec 17 12:40:47.566214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 259/529] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:47 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:48.019310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:48.020342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:48.030995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.031743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.033017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.033753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.172095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:48.180856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:48.182029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:48.183178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4d007ae8-6f09-4cb1-9014-590c5d6258b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.170181 Dec 17 12:40:48.183781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 271/530] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:48.466510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:48.467147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:48.473997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.474438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.475215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.475640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.585603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:48.586210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:48.592740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.593300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.594195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:48.594717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:48.616104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:48.623442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-480327c1-cc87-4f70-a7c1-3176b7d5dd8c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1359 microversion: 2.1 time: 0.161464 Dec 17 12:40:48.623989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 260/531] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:48 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:48.731787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:48.739344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-86876c9e-1615-443f-9a8c-1a3076822ba8 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1515 microversion: 2.1 time: 0.157451 Dec 17 12:40:48.739916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 272/532] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:48 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:49.205317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:49.206380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:49.216836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.217633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.218656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.219074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.354182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.362394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.363864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.365008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7fa149fe-45f2-4fd5-89c3-d855b3a793cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.166273 Dec 17 12:40:49.365589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 261/533] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:49.640159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:49.640812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:49.647618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.648059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.648826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.649251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.755589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:49.756172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:49.762857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.763316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.764089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.764532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.785117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.794706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-356ea939-3b39-49af-8215-677f352ba616 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1549 microversion: 2.1 time: 0.158134 Dec 17 12:40:49.795520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 273/534] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:49 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:49.812831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:49.813457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:49.819930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.820355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.821124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.821614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.896774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.904438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5205c890-6c71-481b-910b-873f5a2a9a29 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1515 microversion: 2.1 time: 0.152505 Dec 17 12:40:49.905009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 262/535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:49 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:49.951190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.959138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e0344a6-f62e-4e7e-818a-91b2b9f052ba tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1549 microversion: 2.1 time: 0.150140 Dec 17 12:40:49.959894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 274/536] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:49 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:49.974683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:49.978108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:40:49.978108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:40:49.979087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:49.979821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Searching by: {'deleted': False, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428'} {{(pid=127717) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 17 12:40:49.986364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.986797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:49.987596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:49.988016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.075593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.multi_cell_list [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 17 12:40:50.173197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cddde158-dcd5-4fe8-9d07-67ed2a96c28d tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201854 Dec 17 12:40:50.173715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 263/537] 10.222.0.45 () {58 vars in 1124 bytes} [Fri Dec 17 12:40:49 2021] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:50.183648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:50.184249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:50.190473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.190909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.191682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.192103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.383199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:50.383782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:50.390267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.390728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.391517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.391958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.427399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:50.439080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-041b22a7-3a9c-47a0-8634-af85c929026c tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1549 microversion: 2.1 time: 0.259003 Dec 17 12:40:50.439911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 275/538] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:50 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:50.523301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:50.531252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:50.532722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:50.533918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-53adc721-e802-49fc-827c-1ecf75efb442 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.154606 Dec 17 12:40:50.534686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 264/539] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:50 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:50.600352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-bf2cebb6-889d-44bb-b8da-da2da808d716 req-68f3a7be-2162-411c-a46a-4c4b29bf1768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927a436f-dc39-4c21-8e02-0b18e32cb477", "name": "network-vif-deleted", "tag": "906dec4b-7145-48aa-90d7-5451b1bd9324"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:40:50.602269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:40:50.602269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:40:50.609504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-bf2cebb6-889d-44bb-b8da-da2da808d716 req-68f3a7be-2162-411c-a46a-4c4b29bf1768 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.610010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-bf2cebb6-889d-44bb-b8da-da2da808d716 req-68f3a7be-2162-411c-a46a-4c4b29bf1768 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.621811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-bf2cebb6-889d-44bb-b8da-da2da808d716 req-68f3a7be-2162-411c-a46a-4c4b29bf1768 service nova] Creating event network-vif-deleted:906dec4b-7145-48aa-90d7-5451b1bd9324 for instance 927a436f-dc39-4c21-8e02-0b18e32cb477 on hv-cinder-80152 Dec 17 12:40:50.626878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-bf2cebb6-889d-44bb-b8da-da2da808d716 req-68f3a7be-2162-411c-a46a-4c4b29bf1768 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030108 Dec 17 12:40:50.627492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 276/540] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:40:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:40:50.922487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:50.923493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:50.932454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.933096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.934248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.934861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.966783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:50.967227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:50.967697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lazy-loading 'fault' on Instance uuid 927a436f-dc39-4c21-8e02-0b18e32cb477 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:40:51.008021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:51.015780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-771b5238-9165-447a-9d3a-a3abdfc38ebe tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 200 len: 1308 microversion: 2.1 time: 0.098721 Dec 17 12:40:51.016386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 265/541] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:50 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:40:51.557669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:51.558804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:51.567032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:51.567478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:51.568264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:51.568698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:51.706583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:51.718774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:51.721201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:51.723060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eed8065d-48fa-4fc4-ac57-767ad965ccfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.172767 Dec 17 12:40:51.723896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 277/542] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:51 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:52.032491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:52.033136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 927a436f-dc39-4c21-8e02-0b18e32cb477] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:52.039761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:52.040206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:52.040983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:52.041449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:52.055396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Instance 927a436f-dc39-4c21-8e02-0b18e32cb477 could not be found. Dec 17 12:40:52.056208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 404 to user: Instance 927a436f-dc39-4c21-8e02-0b18e32cb477 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:40:52.057546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3b5c62f4-01c1-48af-9adc-22ff8d5dbc34 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477" status: 404 len: 111 microversion: 2.1 time: 0.028459 Dec 17 12:40:52.058066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 266/543] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:40:52 2021] GET /compute/v2.1/servers/927a436f-dc39-4c21-8e02-0b18e32cb477 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:40:52.753802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:52.754785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:52.765527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:52.766317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:52.767090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:52.767512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:52.899365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:52.908784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:52.910291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:52.911434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4ca2283-2a07-41f7-ae57-de1bd9abeaf7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.163792 Dec 17 12:40:52.912104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 278/544] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:53.930025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:53.930591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:53.937116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:53.937675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:53.946747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:53.946747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:54.083013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:54.091067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:54.092540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:54.093727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c5cc86fc-ea83-46ce-ab59-2074ce0aef7d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.167617 Dec 17 12:40:54.094338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 267/545] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:53 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:55.111676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:55.112248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:55.119063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:55.119501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:55.120268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:55.120697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:55.249898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:55.259930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:55.261446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:55.262983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c4f34fb5-32e8-48fb-81de-934fd151ceb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.154764 Dec 17 12:40:55.263841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 279/546] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:56.285334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:56.286311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:56.296869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:56.297536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:56.298304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:56.298725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:56.435621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:56.448037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:56.450298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:56.452368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-75b5a4a5-7ad2-4c53-a37d-7eb50a7bd5a7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.172661 Dec 17 12:40:56.453121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 268/547] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:57.474546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:57.475571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:57.486591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:57.487323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:57.488608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:57.489347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:57.630552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:57.638413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:57.639944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:57.641179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8e90daf0-d3ab-44c4-b73e-5b186200c0fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.172878 Dec 17 12:40:57.641779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 280/548] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:58.663049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:58.664029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:58.673745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:58.674186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:58.674952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:58.675374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:58.808989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:58.817123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:58.818634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:40:58.819779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-755ceca9-f6a5-4e7e-b69a-9a4ca8dcf887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1725 microversion: 2.20 time: 0.163045 Dec 17 12:40:58.820370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 269/549] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:40:59.837481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:40:59.844231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:40:59.846125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:59.846621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:40:59.847383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:40:59.847811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:00.237608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:00.246372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:00.247862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:00.248997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e03f9589-90f9-438b-be20-0f535b873dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.415493 Dec 17 12:41:00.249804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 281/550] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:40:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:01.267132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:01.267797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:01.274503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:01.275260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:01.275708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:01.276178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:01.405336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:01.413146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:01.414661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:01.415805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-54332441-8c54-4b9d-8049-6917c7b4d6a5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.152430 Dec 17 12:41:01.416375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 270/551] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:02.277261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-fef9d9d9-7b54-49f5-bd56-d400bf08f68a req-d17dc494-5618-4564-b43a-0e21c4197237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "name": "network-vif-plugged", "status": "completed", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:02.279085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:41:02.279085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:41:02.286571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fef9d9d9-7b54-49f5-bd56-d400bf08f68a req-d17dc494-5618-4564-b43a-0e21c4197237 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:02.287002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fef9d9d9-7b54-49f5-bd56-d400bf08f68a req-d17dc494-5618-4564-b43a-0e21c4197237 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:02.297995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-fef9d9d9-7b54-49f5-bd56-d400bf08f68a req-d17dc494-5618-4564-b43a-0e21c4197237 service nova] Creating event network-vif-plugged:2bde72e9-a3e5-4681-8047-cba579d4e1cb for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 on hv-cinder-80152 Dec 17 12:41:02.303021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-fef9d9d9-7b54-49f5-bd56-d400bf08f68a req-d17dc494-5618-4564-b43a-0e21c4197237 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029500 Dec 17 12:41:02.303800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 282/552] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:41:02.434030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:02.434579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:02.441642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:02.442097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:02.442881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:02.443314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:02.579742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:02.587618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:02.589113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:02.590300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a69e53fb-afc2-4ade-a329-a371726b835d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.160197 Dec 17 12:41:02.590860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 271/553] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:03.613537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:03.614670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:03.625266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:03.626062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:03.627334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:03.628004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:03.762384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:03.770754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:03.772230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:03.773402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3461c380-fd47-49e5-8033-bab78ff64e65 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.167498 Dec 17 12:41:03.773955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 283/554] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:04.791184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:04.791796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:04.798556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:04.799004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:04.799859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:04.800285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:04.939082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:04.947730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:04.949204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:04.950377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-65a7f010-8705-47bc-abb1-650523c88c09 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.162915 Dec 17 12:41:04.950970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 272/555] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:05.972865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:05.973889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:05.984613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:05.985410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:05.986860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:05.987431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:06.121605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:06.130655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:06.132577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:06.133925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e9609752-997b-46de-89b8-9e395d47a57f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1746 microversion: 2.20 time: 0.167366 Dec 17 12:41:06.134501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 284/556] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:07.153236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:07.153927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:07.162199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:07.162614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:07.163581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:07.164117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:07.333029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:07.341386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:07.343158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:07.344317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d2b03db-799f-49e4-a191-3f8e213cff25 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.195236 Dec 17 12:41:07.345067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 273/557] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:08.363585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:08.364265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:08.371487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:08.372004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:08.372989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:08.373640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:08.508992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:08.516989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:08.518537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:08.519690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f43c6d98-e7c4-428a-a46d-2a8da8a35961 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.160038 Dec 17 12:41:08.522364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 285/558] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:09.538680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:09.540114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:09.547018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:09.547819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:09.548768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:09.549397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:09.696168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:09.704442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:09.706102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:09.707485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f6f036cf-d0c5-4026-9845-4d4ad393d15a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.172787 Dec 17 12:41:09.708049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 274/559] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:10.727860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:10.729465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:10.737750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:10.738348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:10.739295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:10.739882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:10.903728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:10.913380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:10.914763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:10.915931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fbf83918-d97a-42f3-9d69-6da0e8e81962 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.192762 Dec 17 12:41:10.916894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 286/560] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:11.933913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:11.934546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:11.941086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:11.941444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:11.942471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:11.942900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:12.076353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:12.084929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:12.086459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:12.087613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ff0791d8-b3d4-41da-bd4f-0fe3d5389f31 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.157526 Dec 17 12:41:12.088181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 275/561] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:11 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:13.105636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:13.106265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:13.112825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:13.113268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:13.114062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:13.114738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:13.256129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:13.264000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:13.265863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:13.267049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b3a82cd7-1a1e-40d7-9e7f-a93acf2159c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.165245 Dec 17 12:41:13.268504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 287/562] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:14.284889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:14.285723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:14.292152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:14.292699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:14.293560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:14.294458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:14.430341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:14.438197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:14.439690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:14.440839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-805e602d-3b44-4020-a5e8-cc875881d288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.159645 Dec 17 12:41:14.441433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 276/563] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:15.459075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:15.460427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:15.467002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:15.467683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:15.468690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:15.469202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:15.611133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:15.620836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:15.622831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:15.624927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31f09e86-a85d-46e8-9645-35eea82cd1b6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.169482 Dec 17 12:41:15.638451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 288/564] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:16.645448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:16.647177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:16.654518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:16.655053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:16.655907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:16.656498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:16.806784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:16.816173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:16.817672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:16.818930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dd9dc3c6-0a2e-4091-a5fc-5673e3e842eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.178786 Dec 17 12:41:16.819480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 277/565] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:17.837441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:17.838078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:17.845495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:17.845935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:17.846730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:17.847157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:18.006718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:18.016205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:18.019317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:18.019317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1921a536-b39e-404c-a786-0327b0c4fb6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.185354 Dec 17 12:41:18.030031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 289/566] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:19.037750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:19.038351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:19.044835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:19.045300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:19.046101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:19.046532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:19.182117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:19.190007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:19.191491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:19.192639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-740112d2-43aa-4f8a-b9c1-44364022f6f2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1741 microversion: 2.20 time: 0.158822 Dec 17 12:41:19.193319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 278/567] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:20.211307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:20.212079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:20.218315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:20.218872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:20.219890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:20.220317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:20.454149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:20.462399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:20.463919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:20.465070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b4332ff5-f1b8-4cd5-bb03-3103495de7eb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1723 microversion: 2.20 time: 0.257885 Dec 17 12:41:20.465942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 290/568] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:21.487467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:21.488485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:21.499177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:21.499813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:21.501150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:21.501912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:21.639717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:21.648504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:21.650022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:21.651222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-480cc501-4211-4afa-a041-3c072ff88c4e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1723 microversion: 2.20 time: 0.170046 Dec 17 12:41:21.651787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 279/569] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:22.297663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-813bf40d-4b48-481d-a267-bc721f5deab8 req-d960d404-7e83-4436-9355-184699bf02bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "name": "network-vif-unplugged", "status": "completed", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:22.299647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:41:22.299647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:41:22.307931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-813bf40d-4b48-481d-a267-bc721f5deab8 req-d960d404-7e83-4436-9355-184699bf02bb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:22.309206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-813bf40d-4b48-481d-a267-bc721f5deab8 req-d960d404-7e83-4436-9355-184699bf02bb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:22.322130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-813bf40d-4b48-481d-a267-bc721f5deab8 req-d960d404-7e83-4436-9355-184699bf02bb service nova] Creating event network-vif-unplugged:2bde72e9-a3e5-4681-8047-cba579d4e1cb for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 on hv-cinder-80152 Dec 17 12:41:22.327618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-813bf40d-4b48-481d-a267-bc721f5deab8 req-d960d404-7e83-4436-9355-184699bf02bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034664 Dec 17 12:41:22.328413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 291/570] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:41:22.673975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:22.674594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:22.682081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:22.682554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:22.683338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:22.683758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:22.812368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:22.820598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:22.822157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:22.823306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f1b5b27-774f-4a5b-a42c-8a1cb798c1a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1666 microversion: 2.20 time: 0.153086 Dec 17 12:41:22.823845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 280/571] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:22.841419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc3b5509-990e-4de5-bcd2-1ae706765447"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:22.842547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:22.849172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:22.849715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:22.850493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:22.850916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:23.139167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a8b9e935-ee7f-45c5-a67c-2b2a9eb384f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301872 Dec 17 12:41:23.139839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 292/572] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Dec 17 12:41:22 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:41:23.253707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:23.254276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:23.260610 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:23.261058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:23.261885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:23.262316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:23.354756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f0275d22-713d-4164-8a0b-4d836a16d385 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action" status: 202 len: 0 microversion: 2.20 time: 0.104773 Dec 17 12:41:23.358490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 281/573] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:41:23 2021] POST /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:41:23.363528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:23.364133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:23.371597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:23.371903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:23.372686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:23.373305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:23.508107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:23.516358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:23.517887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:23.519056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-115162a2-8987-4176-b3f5-e086b86ad8bc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1752 microversion: 2.20 time: 0.159272 Dec 17 12:41:23.519615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 293/574] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:24.542872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:24.543732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:24.562695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:24.563213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:24.564286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:24.564793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:24.710149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:24.719154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:24.720631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:24.721828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-347c0bf5-83e8-477a-85b2-201613ceab36 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.186282 Dec 17 12:41:24.722392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 282/575] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:25.744671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:25.745659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:25.756112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:25.756567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:25.757373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:25.757793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:25.883388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:25.892349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:25.893885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:25.895039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-173c0f43-0c1f-4ea2-9cc4-a49f849054c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.157360 Dec 17 12:41:25.895608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 294/576] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:26.913532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:26.914119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:26.926762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:26.927349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:26.928188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:26.928618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:27.283194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:27.292092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:27.293592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:27.294766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4718a310-3c73-48aa-bb06-b8ef8a134640 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.385045 Dec 17 12:41:27.295329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 283/577] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:28.314717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:28.315340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:28.323298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:28.323775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:28.324561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:28.324996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:28.460017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:28.468249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:28.469757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:28.470891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38402576-ef17-4e43-ab48-7dc33f9c4107 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.160935 Dec 17 12:41:28.471492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 295/578] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:29.497270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:29.498360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:29.507657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:29.508103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:29.508875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:29.509310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:29.648348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:29.656800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:29.658333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:29.659483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-94f3948a-7e48-4b3e-ba23-7526cda8a853 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168393 Dec 17 12:41:29.660051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 284/579] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:30.680158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:30.680761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:30.687445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:30.687887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:30.688651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:30.689079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:30.817381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:30.825791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:30.827583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:30.828741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-89039e22-531c-464e-8f3f-6e6f874ac311 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.153898 Dec 17 12:41:30.829343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 296/580] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:31.846212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:31.846813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:31.853617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:31.854062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:31.854829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:31.855260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:31.997958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:32.006245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:32.007806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:32.008947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b2cbb352-c270-404d-a59a-2b844cd286fc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166494 Dec 17 12:41:32.009559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 285/581] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:31 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:33.030774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:33.031753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:33.041915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:33.042642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:33.043896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:33.044611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:33.180942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:33.189176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:33.190682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:33.191817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23f677f6-2fc1-4bd6-93b9-0551474a5356 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167195 Dec 17 12:41:33.192374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 297/582] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:34.210414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:34.211028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:34.217680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:34.218131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:34.218900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:34.219328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:34.349502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:34.358217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:34.359724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:34.360990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a30dece6-0c60-4131-bf94-967ddf324edf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.154295 Dec 17 12:41:34.361612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 286/583] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:34 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:35.382826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:35.383689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:35.390476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:35.390918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:35.391688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:35.392114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:35.536634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:35.546297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:35.547769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:35.548910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ef980fe-58e5-4c8f-89dd-49494aab059e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.172317 Dec 17 12:41:35.549497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 298/584] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:36.570741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:36.572525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:36.583825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:36.584573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:36.585914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:36.586598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:36.727351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:36.740106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:36.742591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:36.743812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e13d89df-34ac-4e83-83ee-658288318031 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.179296 Dec 17 12:41:36.744385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 287/585] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:37.763788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:37.764379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:37.771225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:37.771671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:37.772456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:37.772885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:37.915672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:37.923954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:37.928154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:37.928154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-761dc25f-08d7-4177-ae17-bac3f11dc5df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167653 Dec 17 12:41:37.928154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 299/586] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:38.943878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:38.944474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:38.950656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:38.951014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:38.951788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:38.952223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:39.002544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:39.004322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:39.010322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:39.010698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:39.011474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:39.011905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:39.035007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lazy-loading 'flavor' on Instance uuid 21d1af76-68e9-4515-8374-ecae895e7c09 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:41:39.088152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:39.096288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:39.097798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:39.098950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bd5c7faa-661f-4f67-bf39-a0aaf57bd710 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.158788 Dec 17 12:41:39.099529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 288/587] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:39.161312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6c88ef26-78c7-4347-ae2a-e562246ad41c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action" status: 200 len: 32 microversion: 2.1 time: 0.162932 Dec 17 12:41:39.162072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 300/588] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:41:38 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 12:41:39.171807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:39.172485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:39.179004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:39.179447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:39.180346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:39.180814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:39.308602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:39.316944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3c8ece7a-19cc-4fdf-8f42-82c9290a6b50 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.149579 Dec 17 12:41:39.317950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 289/589] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:40.122118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:40.123154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:40.134062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:40.134787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:40.135554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:40.135980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:40.272281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:40.280970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:40.282496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:40.283643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06857bff-760f-4849-8225-4472267e833b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168562 Dec 17 12:41:40.284176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 301/590] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:40 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:40.334699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:40.335264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:40.342329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:40.342774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:40.343563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:40.343991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:40.476335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:40.484993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d8753551-7d05-433d-8637-04ee767493f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.153996 Dec 17 12:41:40.485574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 290/591] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:41.302240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:41.302822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:41.309644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:41.310093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:41.310859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:41.311287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:41.450327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:41.459460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:41.460961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:41.462881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9508815a-eef2-47fe-b6f4-01e23c3be475 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164390 Dec 17 12:41:41.463457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 302/592] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:41.502222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:41.502759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:41.509134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:41.509630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:41.510455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:41.510883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:41.642711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:41.654381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30bf54eb-d372-4470-9168-a7f4a03a1c1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.155768 Dec 17 12:41:41.655107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 291/593] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:42.484424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:42.485474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:42.495929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:42.496672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:42.497987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:42.498710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:42.671504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:42.672124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:42.678272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:42.678853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:42.679644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:42.680105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:42.680383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:42.689001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:42.690486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:42.691888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-36d72c04-e144-45f2-b50d-46627f0d817e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.213825 Dec 17 12:41:42.692676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 303/594] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:42.874405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:42.886202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9c61c91e-996a-42ed-bd83-e590a1218887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.218350 Dec 17 12:41:42.887049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 292/595] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:43.719831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:43.720816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:43.731288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:43.732014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:43.733333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:43.734013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:43.894446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:43.902957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:43.904485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:43.905661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b8c3ca5-68fc-47e6-b561-52dfbe45f937 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.192229 Dec 17 12:41:43.906229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 304/596] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:43.907958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:43.908568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:43.915032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:43.915486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:43.916368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:43.916955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:44.059770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:44.068314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8d3d3d83-1767-4ae6-9dbb-fc0ed995a908 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.164223 Dec 17 12:41:44.068890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 293/597] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:44.923782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:44.924394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:44.931293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:44.931736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:44.932509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:44.932938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:45.066897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:45.079289 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:45.080870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:45.082044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-775d966a-eaf6-44b8-8178-9bfd1cf4a73a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.162011 Dec 17 12:41:45.082572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 305/598] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:45.085924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:45.086608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:45.093405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:45.093854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:45.094635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:45.095066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:45.237484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:45.245470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7ad4a59f-0f46-465b-8a89-ca6d89a01cd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.163440 Dec 17 12:41:45.246063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 294/599] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:46.103149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:46.103979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:46.114668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:46.115395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:46.116661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:46.117379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:46.261963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:46.262575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:46.268902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:46.269243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:46.269757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:46.270536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:46.270963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:46.277408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:46.278910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:46.280050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c3d54c5-ca7b-4ceb-95ea-a27906ea3150 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.183175 Dec 17 12:41:46.280823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 306/600] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:46 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:46.401306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:46.410309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9cba690e-0654-4ea8-a23d-e753ae0901ce tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.152423 Dec 17 12:41:46.410885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 295/601] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:47.302126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:47.303166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:47.311780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:47.312223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:47.312995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:47.313457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:47.427602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:47.428517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:47.435631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:47.436159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:47.436933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:47.437365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:47.459730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:47.468181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:47.469760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:47.470914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32fd7eb2-0d2b-495d-9570-b11b5fcdb2f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.175041 Dec 17 12:41:47.471484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 307/602] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:47.564383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:47.572277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2b4412ed-f3e9-403d-8828-98f596280f3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.148364 Dec 17 12:41:47.573034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 296/603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:48.493179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:48.494108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:48.504829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:48.505622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:48.506889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:48.507648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:48.589410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:48.589986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:48.596895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:48.597365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:48.598110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:48.598754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:48.639784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:48.649190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:48.651020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:48.652195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ba8be30a-af40-4897-86a1-3452506caf4f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.165448 Dec 17 12:41:48.652945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 308/604] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:48.729975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:48.737944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4da11db1-7a09-4ba5-bed0-8f91efe01d95 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.152326 Dec 17 12:41:48.738514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 297/605] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:49.754949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:49.755596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:49.762272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:49.762745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:49.763530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:49.763940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:49.774890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:49.775570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:49.782246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:49.782657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:49.783452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:49.783872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:49.896484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:49.905777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-673337cc-5a5d-4939-849e-6ee28010b563 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.154315 Dec 17 12:41:49.915572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 298/606] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:49.916135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:49.923349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:49.924872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:49.926058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45acd3bd-7931-4c0c-b1a1-f6bb7ee72516 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.259573 Dec 17 12:41:49.926620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 309/607] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:50.927387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:50.928379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:50.939118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:50.939854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:50.941253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:50.942015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:50.949377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:50.949943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:50.956869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:50.957375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:50.958133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:50.958559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:51.078781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:51.086896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bbbe1612-9220-4bd9-ad0a-6531bfb8e416 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.165950 Dec 17 12:41:51.087524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 299/608] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:51.087673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:51.096410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:51.098164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:51.099326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b21b2aef-b4fa-44cb-9b60-a9ab071ba754 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.156273 Dec 17 12:41:51.099882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 310/609] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:50 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:52.107862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:52.108780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:52.119507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:52.120242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:52.120802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:52.121447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:52.121633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:52.121885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:52.128359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:52.128809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:52.129646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:52.130079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:52.253465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:52.263386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8e931a68-6acb-414c-a4eb-2453518f5497 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.161658 Dec 17 12:41:52.263605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:52.264488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 300/610] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:52.272203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:52.274745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:52.276094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f7301e31-acdb-4b39-94aa-5a46a243a36a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161381 Dec 17 12:41:52.276849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 311/611] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:41:53.280021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:53.280667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:53.287493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:53.287944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:53.288731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:53.289165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:53.293425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:53.294032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:53.300981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:53.301458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:53.302247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:53.302679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:53.423830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:53.431499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-270f5236-f889-401f-be9a-e228160fdbe2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.155283 Dec 17 12:41:53.432073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 301/612] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:53.435411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:53.443676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:53.445161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:53.446398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce66126b-a1ee-4fee-afaf-f26623a0d340 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.156837 Dec 17 12:41:53.446950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 312/613] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:53 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:54.451152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:54.451727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:54.458723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.459191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.459957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.460386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.463748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:54.464355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:54.470807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.471251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.472022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.472455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.593674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:54.602490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:54.602680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f59dae62-3697-43dd-b3b2-fd433e9cb4ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1546 microversion: 2.1 time: 0.156480 Dec 17 12:41:54.603350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 302/614] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:54.611713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:54.613112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:54.614268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cb23aa77-db1a-4916-8af6-6bf5e75a4ae7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.154234 Dec 17 12:41:54.614860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 313/615] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:54.619146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:54.619628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:54.625690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.626131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.626896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.627318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.715760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] HTTP exception thrown: Cannot 'detach_volume' instance 21d1af76-68e9-4515-8374-ecae895e7c09 while it is in vm_state rescued Dec 17 12:41:54.716511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Returning 409 to user: Cannot 'detach_volume' instance 21d1af76-68e9-4515-8374-ecae895e7c09 while it is in vm_state rescued {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:41:54.717379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9bf446e6-54ce-4a47-91b5-3926f8c81409 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments/8d4bf7a0-7e83-4fd4-bdea-23f367524cf3" status: 409 len: 152 microversion: 2.1 time: 0.102117 Dec 17 12:41:54.717965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 303/616] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:41:54 2021] DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments/8d4bf7a0-7e83-4fd4-bdea-23f367524cf3 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 17 12:41:54.726608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:41:54.727208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:54.734165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.734791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.735566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.735997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.803774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ba8e8da7-8d46-4298-bbd7-f3b747013736 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action" status: 202 len: 0 microversion: 2.1 time: 0.080828 Dec 17 12:41:54.807606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 314/617] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:41:54 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:41:54.812695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:54.813325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:54.819327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.819812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.821013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:54.821621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:54.969385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:54.977533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e8211196-4531-47fb-af6f-5582cfca0989 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1554 microversion: 2.1 time: 0.168364 Dec 17 12:41:54.978104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 304/618] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:55.634860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:55.635866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:55.645491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:55.646111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:55.647214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:55.648022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:55.787725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:55.796220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:55.797753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:55.798968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e220501d-edbc-46f5-8314-5db91528fc18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.169589 Dec 17 12:41:55.799814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 315/619] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:55.997329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:55.998075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:56.007886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:56.008584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:56.009911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:56.010598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:56.158646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:56.167354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f1d4958-e081-408f-ac9b-5c5bf637a916 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1554 microversion: 2.1 time: 0.174333 Dec 17 12:41:56.167964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 305/620] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:56.816761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:56.817429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:56.824637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:56.825081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:56.825891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:56.826561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:56.961939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:56.970650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:56.972134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:56.973320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9be915dc-e2c5-4c37-a33c-21f78fd9fd52 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.160477 Dec 17 12:41:56.973852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 316/621] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:57.188197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:57.189152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:57.199880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:57.200620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:57.201973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:57.203046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:57.341009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:57.349752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e13a6ef5-a98e-4d60-b943-75ff964a58cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1554 microversion: 2.1 time: 0.167863 Dec 17 12:41:57.350324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 306/622] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:57.997128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:57.998317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:58.007472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:58.007915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:58.008693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:58.009129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:58.156471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:58.165388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:58.166882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:58.168038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a71f1ed-5565-4ec4-8a71-8b9355885d6d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.178619 Dec 17 12:41:58.168607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 317/623] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:58.371088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:58.371639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:58.382318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:58.382965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:58.384178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:58.384811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:58.523924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:58.532987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9a7fb361-2aed-4e89-a614-fb6ded2abc5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1554 microversion: 2.1 time: 0.168281 Dec 17 12:41:58.533636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 307/624] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:59.186291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:59.186856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:59.193560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.194012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.194773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.195184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.349678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:59.362891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:59.365208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:59.366987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-be22b1ad-8df2-4523-9a0b-3a829f2cbb75 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.184287 Dec 17 12:41:59.367861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 318/625] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:41:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:41:59.554141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:59.554964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:59.562690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.563131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.563906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.564338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.697458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:41:59.706020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bf99253b-4ccb-4d6e-a6c5-d1c4baa752f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1560 microversion: 2.1 time: 0.158258 Dec 17 12:41:59.706588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 308/626] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:41:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:41:59.779005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:59.779735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:59.789005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.789692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.790803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.791393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.867851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lazy-loading 'services' on Instance uuid 21d1af76-68e9-4515-8374-ecae895e7c09 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:41:59.941014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-79b8e069-dd86-421c-a081-bdadfeb19920 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments/8d4bf7a0-7e83-4fd4-bdea-23f367524cf3" status: 202 len: 0 microversion: 2.1 time: 0.167745 Dec 17 12:41:59.941674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 319/627] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:41:59 2021] DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments/8d4bf7a0-7e83-4fd4-bdea-23f367524cf3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:41:59.950035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:41:59.951001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:41:59.957547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.958312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.959362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:41:59.959851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:41:59.990721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-62277ff3-b63a-4a7a-b72e-208eb589ea46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Dec 17 12:41:59.991276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 309/628] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:41:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:00.390040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:00.391241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:00.401952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:00.402562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:00.403343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:00.403777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:00.539022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:00.548055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:00.549575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:00.550726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-22338c3c-ea66-40ee-8f89-e9388a11fbfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168326 Dec 17 12:42:00.551291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 320/629] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:01.006346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:01.007702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:01.018626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:01.019358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:01.020627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:01.021344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:01.052865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-460fa10d-51f5-4f85-8894-f624730e76fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053041 Dec 17 12:42:01.053443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 310/630] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:01.572610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:01.573651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:01.584537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:01.585380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:01.586678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:01.587387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:01.725096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:01.733813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:01.735302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:01.736488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c333c6fd-38c4-480a-8c38-c210531e3712 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.170136 Dec 17 12:42:01.737025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 321/631] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:02.068014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:02.069582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:02.080253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:02.080939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:02.082242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:02.082894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:02.120066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-80990e08-fedb-4bde-8f66-d98fa5608e0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058398 Dec 17 12:42:02.120616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 311/632] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:02.761550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:02.762310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:02.768731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:02.769178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:02.769994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:02.770425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:02.899872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:02.913043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:02.915566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:02.917489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f59d6645-068a-49ce-96ef-c44a46cfeeb7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.162046 Dec 17 12:42:02.918367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 322/633] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:03.135708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:03.137144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:03.148045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:03.148784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:03.150137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:03.150860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:03.180234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a71ccdab-0375-47fe-b2de-ccf4e1b7779d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051033 Dec 17 12:42:03.180838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 312/634] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:03.939678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:03.940671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:03.951437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:03.952184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:03.953882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:03.954604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:04.096051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:04.104813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:04.106317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:04.107455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5e55311-1252-48e3-b02f-47691e30e81c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174214 Dec 17 12:42:04.108010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 323/635] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:04.195861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:04.197365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:04.206364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:04.206840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:04.207612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:04.208039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:04.238905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-167aefb4-a620-4e2d-b664-e2b976f9ec2a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049389 Dec 17 12:42:04.239467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 313/636] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:05.129048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:05.130103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:05.139355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:05.139806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:05.140582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:05.141013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:05.250556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:05.251604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:05.258133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:05.258658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:05.259502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:05.260006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:05.284039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:05.289977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-01d05c01-581c-4988-a832-dc23f3266061 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Dec 17 12:42:05.290557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 314/637] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:42:05.292437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:05.294064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:05.295186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c7bc0282-be1f-4fa7-bb3f-7a7a0de11d1a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.172369 Dec 17 12:42:05.295739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 324/638] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:06.305827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:06.307355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:06.313743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:06.314340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:06.314645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:06.315099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:06.315888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:06.316324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:06.320806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:06.321271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:06.322064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:06.322487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:06.346294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9baaf6bb-b0a3-4d66-98dd-700f939db2b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 Dec 17 12:42:06.347094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 315/639] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:06.455797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:06.469042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:06.471389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:06.472892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c65b358e-656e-4b88-aa6f-e71f19f04d53 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.162649 Dec 17 12:42:06.473678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 325/640] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:07.361481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:07.362936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:07.373760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:07.374490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:07.375756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:07.376463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:07.409616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-391e53d6-5b04-4fb0-9ebe-0f0d86c7363f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054572 Dec 17 12:42:07.410169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 316/641] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:07.496713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:07.497779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:07.508069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:07.508809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:07.510114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:07.510829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:07.637212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:07.646293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:07.647815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:07.648932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6f1d231-6609-44b2-bb80-2a7a3528a6f6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.158316 Dec 17 12:42:07.649506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 326/642] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:08.425647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:08.427159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:08.436785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:08.437234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:08.438074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:08.438485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:08.467698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f9c7599f-0bd1-4b60-995a-581882553e0a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 Dec 17 12:42:08.468239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 317/643] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:08.668012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:08.668651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:08.675155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:08.675606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:08.676432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:08.676816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:08.820429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:08.829634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:08.831133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:08.832274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b96710b9-8b5e-4802-8fbf-d901ca4d1698 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168057 Dec 17 12:42:08.832838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 327/644] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:09.483490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:09.484516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:09.492715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:09.493322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:09.494299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:09.494845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:09.527760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3ffabc25-7a91-40ce-af54-2802bbb55ae3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050798 Dec 17 12:42:09.528303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 318/645] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:09.851372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:09.852085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:09.859864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:09.860391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:09.861310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:09.861853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:10.001161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:10.010361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:10.011860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:10.013010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c153db1-facb-4f5c-a563-d130810e098b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166081 Dec 17 12:42:10.013580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 328/646] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:10.543253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:10.544748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:10.555399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:10.556109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:10.557442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:10.558175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:10.593819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20e52adf-62e3-4edb-9f84-ce5752b7ef41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056785 Dec 17 12:42:10.594393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 319/647] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:11.035049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:11.036034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:11.046007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:11.046447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:11.047214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:11.047641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:11.176591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:11.185080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:11.186634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:11.187900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bf694bc6-562f-4286-a825-f0b2e9548f44 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.159123 Dec 17 12:42:11.188353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 329/648] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:11 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:11.609365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:11.610867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:11.621735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:11.622482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:11.623471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:11.623906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:11.654179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2970ad32-ec1c-4bde-8deb-174c13cdefd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051002 Dec 17 12:42:11.654766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 320/649] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:12.207379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:12.208199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:12.215933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:12.216529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:12.217343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:12.217796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:12.362183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:12.374775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:12.376271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:12.377503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-537ec268-7176-4841-8be9-2fbf76a5b1f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174956 Dec 17 12:42:12.378108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 330/650] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:12.670122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:12.671373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:12.678089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:12.678535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:12.679311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:12.679742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:12.709057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6b9146bf-494f-4db6-a3cc-f4446c8e5191 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Dec 17 12:42:12.709664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 321/651] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:13.399551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:13.400549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:13.411180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:13.411922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:13.413214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:13.414000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:13.543779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:13.552410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:13.553939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:13.555088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ccc56c02-4cb8-4011-93f8-f67b46c6476f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161855 Dec 17 12:42:13.555628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 331/652] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:13.723428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:13.724924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:13.735572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:13.736324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:13.737666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:13.738394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:13.772673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0e7657c0-fb44-4d60-96c8-86a7a7f018f4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055757 Dec 17 12:42:13.773229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 322/653] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:14.579175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:14.580106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:14.591099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:14.591731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:14.592991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:14.593423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:14.726202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:14.737445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:14.738929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:14.740076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6494d013-f512-4d7d-8184-20e94c493a9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167608 Dec 17 12:42:14.740640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 332/654] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:14.784398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:14.785318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:14.791907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:14.792349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:14.793114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:14.793651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:14.823069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-00940188-1b31-4861-965d-6a2f17420b62 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Dec 17 12:42:14.823611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 323/655] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:15.762393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:15.763313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:15.773992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:15.774746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:15.776009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:15.776725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:15.835254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:15.836178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:15.843093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:15.843534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:15.844323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:15.844752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:15.873662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c59c3633-be3a-4bc0-8ff4-4357e3904d61 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Dec 17 12:42:15.874305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 324/656] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:15.909907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:15.922939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:15.925237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:15.927081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0310799a-00fe-4c80-98db-cf5505ec1ab6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.170793 Dec 17 12:42:15.927700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 333/657] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:16.889237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:16.890379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:16.897047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:16.897525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:16.898301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:16.898732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:16.927342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d9baea7-0ebd-4309-9ad7-0600300ce4cb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Dec 17 12:42:16.927881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 325/658] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:16.948048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:16.948650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:16.955373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:16.955823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:16.956595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:16.957029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:17.088535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:17.097307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:17.098822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:17.099972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eba5a296-bba4-45f8-84e5-d594f5b85377 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.155705 Dec 17 12:42:17.100540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 334/659] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:17.942949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:17.944445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:17.954394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:17.954866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:17.955644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:17.956065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:17.984883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-75d0517a-5ca0-4257-b82e-7f6acf229bdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048358 Dec 17 12:42:17.985461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 326/660] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:18.117913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:18.118599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:18.125568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:18.126021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:18.126801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:18.127237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:18.256921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:18.265363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:18.266924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:18.268170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8cf28344-f30b-49b9-8f6c-f5771e8275b5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.154097 Dec 17 12:42:18.268935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 335/661] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:18 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:19.000223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:19.001336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:19.009490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:19.010060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:19.011021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:19.011665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:19.044653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8651cc1b-5fbf-4033-9714-c0d2f85c7b1f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050515 Dec 17 12:42:19.045221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 327/662] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:19.290408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:19.291438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:19.299877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:19.300320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:19.301092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:19.301552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:19.444644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:19.453496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:19.455004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:19.456142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6c52979-cb72-4501-b6c5-070c33849784 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.171903 Dec 17 12:42:19.456709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 336/663] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:20.059625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:20.061048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:20.071905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:20.072643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:20.074009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:20.074726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:20.104874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-29fd54a1-7996-4ec5-95d5-4e297eb19fb4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051634 Dec 17 12:42:20.105469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 328/664] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:20.478300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:20.479127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:20.489953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:20.490687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:20.491963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:20.492675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:20.631786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:20.642253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:20.643720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:20.644873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4389942d-59d2-41fe-a2fb-60c6beaed353 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.172967 Dec 17 12:42:20.645467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 337/665] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:21.120208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:21.121643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:21.129438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:21.129893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:21.130676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:21.131112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:21.161663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7ae5b9fc-0a1f-429b-8c45-77192136f301 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047983 Dec 17 12:42:21.162208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 329/666] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:21.667020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:21.668117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:21.676338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:21.676785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:21.677601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:21.678035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:21.815291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:21.826295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:21.827775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:21.829262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-87e76292-f6a5-4443-9b8b-fc59c5383242 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168473 Dec 17 12:42:21.829849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 338/667] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:22.174686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:22.175623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:22.182010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:22.182457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:22.183218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:22.183644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:22.213251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61c3c60f-ecfe-45e7-9293-099d738e6a5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Dec 17 12:42:22.213860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 330/668] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:22.846661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:22.847268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:22.854014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:22.854453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:22.855209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:22.855634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:22.999302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:23.007988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:23.009437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:23.010593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4587158-8bcb-4260-bcb7-36698f687c7f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167888 Dec 17 12:42:23.011157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 339/669] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:23.229085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:23.230603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:23.238401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:23.238852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:23.239622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:23.240047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:23.269858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7e7652b1-7cdd-42ce-9c3e-285cf5e4648f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047068 Dec 17 12:42:23.270350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 331/670] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:24.032043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:24.032874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:24.039977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:24.040498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:24.041375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:24.041797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:24.175496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:24.184101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:24.185599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:24.186789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-415536b4-bd33-45db-b584-9cdf2a4437ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.159982 Dec 17 12:42:24.187319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 340/671] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:24.283770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:24.285106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:24.292440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:24.292939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:24.293801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:24.294292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:24.324600 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44668362-dce3-4565-bc42-3c7967314b7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Dec 17 12:42:24.325140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 332/672] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:25.209153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:25.210034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:25.220649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:25.221443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:25.222704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:25.223418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:25.336065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:25.336969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:25.343685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:25.344157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:25.344924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:25.345376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:25.357943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:25.366291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:25.367768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:25.368912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3c9fc7c-b68b-4ea2-aff7-9c5791b56dc3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166538 Dec 17 12:42:25.369505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 341/673] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:25.375622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f8aa44ac-a88f-4187-8fe2-41c88799f95a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Dec 17 12:42:25.376149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 333/674] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:26.390466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:26.391405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:26.392091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:26.392375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:26.403690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:26.404393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:26.405708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:26.406043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:26.406414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:26.406620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:26.407702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:26.408272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:26.437508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6f673de4-22ed-4e3a-9b48-ad3cd5c8da38 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052704 Dec 17 12:42:26.438068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 334/675] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:42:26.545454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:26.556393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:26.557944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:26.559115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afc51a17-7e78-4b22-a2da-2d3de49ec32a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.175015 Dec 17 12:42:26.559729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 342/676] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:27.458265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:27.459817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:27.469046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:27.469677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:27.470653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:27.471221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:27.505950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ee725ca4-5905-4656-b523-24b7a6695085 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058556 Dec 17 12:42:27.506515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 335/677] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:27.577485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:27.578089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:27.585595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:27.586065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:27.586837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:27.587263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:27.714953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:27.723644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:27.725104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:27.726266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b53961a9-b753-4218-86a0-d16b373d607f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.152598 Dec 17 12:42:27.726866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 343/678] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:27 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:28.521552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:28.523013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:28.533682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:28.534526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:28.535296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:28.535716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:28.567739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7a5360b4-bfc1-441f-baaf-7370e03644cd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052069 Dec 17 12:42:28.568838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 336/679] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:28.748138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:28.749139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:28.757569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:28.758018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:28.758796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:28.759231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:28.890861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:28.899269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:28.900761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:28.901950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8734e1a0-7261-440d-af5d-84d9bcb8e7fb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.160084 Dec 17 12:42:28.902521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 344/680] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:29.584537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:29.586096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:29.596105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:29.596823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:29.598177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:29.598893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:29.633510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b9ab0ea5-ffc9-4a1b-b593-64dfde1da372 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056029 Dec 17 12:42:29.634247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 337/681] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:29.924253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:29.925098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:29.936131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:29.936860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:29.938194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:29.938900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:30.073625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:30.087018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:30.089482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:30.091234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-417c74f2-80f4-40bb-b2fb-e63ddf91fb74 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.173067 Dec 17 12:42:30.092029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 345/682] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:30.647276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:30.648184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:30.655405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:30.655855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:30.656631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:30.657057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:30.690046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4cc71e35-cd73-491e-a519-a53736e4010a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Dec 17 12:42:30.690674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 338/683] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:31.114518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:31.115201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:31.122878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:31.123396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:31.124291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:31.124786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:31.261264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:31.269845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:31.271309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:31.272442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f6808626-9666-4a4f-ac1b-6192b38b2b7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.163718 Dec 17 12:42:31.272995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 346/684] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:31 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:31.706137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:31.707624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:31.718229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:31.719020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:31.720304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:31.721030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:31.751265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-52f3b1e0-9de3-44f8-9a21-1f74e4b16d74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052117 Dec 17 12:42:31.752045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 339/685] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:32.290608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:32.291187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:32.298239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:32.298691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:32.299474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:32.299906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:32.441195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:32.449844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:32.451322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:32.452459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0795d17e-1a6f-40b6-a658-f5ee4f3ee772 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.165703 Dec 17 12:42:32.452986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 347/686] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:32 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:32.766615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:32.768067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:32.778233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:32.778966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:32.780232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:32.780940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:32.817504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4dbaaa6d-fd0d-4ecd-b7a6-beef3bfef1ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057195 Dec 17 12:42:32.818060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 340/687] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:33.474274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:33.474875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:33.481214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:33.481681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:33.482445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:33.482871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:33.621713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:33.630587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:33.632125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:33.633266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-848005d9-c206-43c3-8a15-56d9319391ff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164378 Dec 17 12:42:33.633868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 348/688] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:33.832428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:33.833374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:33.840019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:33.840463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:33.841239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:33.841714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:33.871822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5a333a16-f784-4870-84fc-749cb7461166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Dec 17 12:42:33.872694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 341/689] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:34.656195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:34.657050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:34.667262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:34.667995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:34.669260 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:34.670009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:34.805886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:34.814999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:34.816530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:34.817741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55dc49f6-57b2-4c7a-be04-0c9132d35d11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168746 Dec 17 12:42:34.818299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 349/690] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:34 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:34.883767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:34.884666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:34.891287 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:34.891756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:34.892503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:34.892946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:34.923251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a5078f1-d0aa-41f0-ab49-ef5788450233 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Dec 17 12:42:34.923806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 342/691] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:35.837596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:35.838439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:35.846994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:35.847589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:35.848509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:35.848939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:35.934595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:35.935538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:35.941873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:35.942324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:35.943120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:35.943549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:35.976435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dd8697d6-3254-4aa4-b9fe-21be0fb5e37c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Dec 17 12:42:35.977015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 343/692] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:42:35.978043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:35.986291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:35.987765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:35.988967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1ae52d2-a35a-4513-b9c4-f2746e17ca34 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.156492 Dec 17 12:42:35.989560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 350/693] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:36.990163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:36.991078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:36.997862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:36.998304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:36.999083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:36.999536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:37.006818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:37.007428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:37.022366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:37.023035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:37.023826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:37.024254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:37.029935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-48ceabee-1ea7-49fa-bddb-387e67011a41 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Dec 17 12:42:37.030520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 344/694] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:37.152031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:37.160323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:37.161865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:37.163010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3228bf5d-43fb-4055-a416-05993c1bd643 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.159983 Dec 17 12:42:37.163567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 351/695] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:38.041547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:38.043066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:38.049779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:38.050231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:38.051023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:38.051457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:38.082542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cae04ec7-92a3-4515-9c57-714f3b513c7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Dec 17 12:42:38.083096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 345/696] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:38.184889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:38.186039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:38.196745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:38.197557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:38.198852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:38.199571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:38.337421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:38.350134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:38.352686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:38.354571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-570094ac-47c7-4f30-9504-de7ab0bbd9de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.175570 Dec 17 12:42:38.355402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 352/697] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:39.094011 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:39.094961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:39.101790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:39.102309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:39.103097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:39.103547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:39.133788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-be553406-d2fa-4d92-a988-8071bedb75ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Dec 17 12:42:39.134359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 346/698] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:39.380376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:39.381399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:39.391876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:39.392623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:39.393970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:39.394697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:39.532670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:39.541099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:39.542633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:39.543781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-662a30e3-38c6-4bcb-981c-1b4930746bff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.169965 Dec 17 12:42:39.544388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 353/699] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:40.145100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:40.146066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:40.152662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:40.153091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:40.153976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:40.154436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:40.194030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-38f1653d-2f13-488c-85ed-51d41670003c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052661 Dec 17 12:42:40.194728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 347/700] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:40.564429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:40.565076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:40.574898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:40.575541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:40.576715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:40.577359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:40.712454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:40.720970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:40.722475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:40.723626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-44a887ed-8e4d-49cc-9c3c-eb523af74883 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.163917 Dec 17 12:42:40.724186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 354/701] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:40 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:41.206079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:41.206995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:41.214005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:41.214424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:41.215342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:41.215656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:41.245941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8785261-7a7a-426e-be55-17fa1a094094 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Dec 17 12:42:41.246811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 348/702] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:41.741845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:41.742448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:41.749049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:41.749544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:41.750310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:41.750736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:41.888056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:41.897065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:41.898679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:41.901242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2054d845-fb05-47cb-b72c-d040caa6e178 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161732 Dec 17 12:42:41.901982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 355/703] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:42.257904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:42.258818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:42.265181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:42.265702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:42.266470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:42.266925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:42.296317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2b4bc626-03f9-43d6-910e-5855c43c7495 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042318 Dec 17 12:42:42.296871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 349/704] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:42.922966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:42.924021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:42.932358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:42.932808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:42.933626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:42.934049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:43.069125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:43.078076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:43.079915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:43.081066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-05c01446-272d-4c1e-8139-54e0cba9a0b9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164331 Dec 17 12:42:43.081740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 356/705] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:43.311761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:43.313235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:43.322008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:43.322454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:43.323232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:43.323664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:43.353779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7f7243b0-9cf3-4c2c-ac2f-bbd447283744 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Dec 17 12:42:43.354340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 350/706] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:44.101937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:44.102740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:44.111951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:44.112586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:44.113745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:44.114363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:44.249838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:44.258250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:44.259741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:44.260893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a15b12ab-7aed-4603-b5cf-b8c37852b27e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164539 Dec 17 12:42:44.261542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 357/707] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:44.364960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:44.366035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:44.372008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:44.372447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:44.373203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:44.373650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:44.404707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f5152f5a-c368-41d8-9297-ff04a4be71e8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Dec 17 12:42:44.405254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 351/708] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:45.283023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:45.284065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:45.292939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:45.293416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:45.294213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:45.294639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:45.416342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:45.417266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:45.424005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:45.424460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:45.425245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:45.425838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:45.439442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:45.448056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:45.449680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:45.450833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0d62987e-bab7-4065-8ccb-462ec4e270f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174149 Dec 17 12:42:45.457515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e41ff04f-ccc6-4f06-a6d4-699644b834d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Dec 17 12:42:45.458093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 352/709] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:45.461461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 358/710] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:45 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:46.468780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:46.469328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:46.469711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:46.470925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:46.476210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:46.476654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:46.477429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:46.477860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:46.481028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:46.481549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:46.482770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:46.483184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:46.521432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5242064c-b730-4000-aa34-7c486e20c76c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056315 Dec 17 12:42:46.522007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 353/711] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:46.614511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:46.623483 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:46.624973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:46.626162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-78ea9f60-2cee-4854-8e63-6aa96eea7058 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161007 Dec 17 12:42:46.626726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 359/712] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:46 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:47.534869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:47.536056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:47.543669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:47.544121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:47.544892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:47.545307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:47.574678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-81e6f567-383c-4f27-aadc-4c08f9500ca3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Dec 17 12:42:47.575233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 354/713] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:47.647825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:47.648805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:47.660242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:47.660985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:47.662347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:47.663022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:47.797311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:47.806663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:47.808136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:47.809305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8bc05a8a-b92f-416a-8860-a23572d761ea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167795 Dec 17 12:42:47.809842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 360/714] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:48.588545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:48.589525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:48.596169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:48.596614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:48.597399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:48.597832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:48.627930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f4c5a091-3954-43b7-85a4-88a66d8ef639 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Dec 17 12:42:48.628498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 355/715] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:48.826444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:48.827049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:48.834126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:48.834569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:48.835341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:48.835763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:48.971126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:48.979783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:48.981267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:48.982439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afba1bf1-4e62-4449-a48c-e8dce8349b82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.159815 Dec 17 12:42:48.983001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 361/716] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:49.643210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:49.644943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:49.653151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:49.653650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:49.654471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:49.654897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:49.684852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aaa5a11b-d43f-4c1a-a7d2-1f9d6102c80d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048001 Dec 17 12:42:49.685454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 356/717] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:50.000285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:50.000817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:50.007505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:50.007951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:50.008767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:50.009203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:50.146319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:50.154843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:50.156324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:50.157499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e9636ddf-18bf-4fb5-8c9a-be1e57aa3e85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161144 Dec 17 12:42:50.158060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 362/718] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:50.698643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:50.699557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:50.706292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:50.706742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:50.707521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:50.707947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:50.737007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-914ebf42-14d2-4873-b6f8-b263ea01a1b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Dec 17 12:42:50.737666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 357/719] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:51.175243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:51.175846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:51.182342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:51.182817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:51.183589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:51.184021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:51.313693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:51.322736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:51.324220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:51.325406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b8ab633-be31-4226-b664-9dc7dc1da92c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.154035 Dec 17 12:42:51.325968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 363/720] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:51 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:51.748832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:51.749807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:51.756490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:51.757000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:51.757877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:51.758311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:51.789575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-07bf021f-0e2f-41f3-aef5-20b723102cee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Dec 17 12:42:51.790131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 358/721] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:52.347561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:52.348554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:52.359208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:52.359966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:52.361215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:52.362122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:52.505755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:52.518464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:52.520795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:52.522641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2ac618ae-fd9a-4c95-a148-fd66b6a329f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.181015 Dec 17 12:42:52.523380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 364/722] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:52.807295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:52.808762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:52.819169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:52.819908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:52.821003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:52.821825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:52.851355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3aeedb8d-5bb8-4340-a520-32e54911fb4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052432 Dec 17 12:42:52.852116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 359/723] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:53.550141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:53.551295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:53.562062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:53.562905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:53.564276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:53.565216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:53.701180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:53.714294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:53.716608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:53.718359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fbe0f6b0-e39f-48e9-bfc0-37af9f9c214f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174246 Dec 17 12:42:53.719122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 365/724] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:53 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:53.864184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:53.865237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:53.872153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:53.872641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:53.873492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:53.874001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:53.905034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5815b5e3-6890-4870-96d6-e4acec41dce1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Dec 17 12:42:53.905644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 360/725] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:54.740383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:54.741218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:54.748621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:54.749063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:54.749863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:54.750289 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:54.883102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:54.892345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:54.893898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:54.895054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-62d9a89e-696f-44a9-abbe-816ac0225ecc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.160998 Dec 17 12:42:54.895591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 366/726] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:54.915853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:54.916758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:54.923174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:54.923623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:54.924372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:54.924792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:54.954976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f1e24d24-7cc8-4352-a6d5-87ce476500a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Dec 17 12:42:54.955533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 361/727] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:55.912050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:55.912656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:55.919703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:55.920144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:55.920908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:55.921350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:55.966572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:55.967692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:55.974924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:55.975447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:55.976406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:55.977148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:56.010729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c147e9b9-7a79-44fb-9fb0-d0060d95e7df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Dec 17 12:42:56.011294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 362/728] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:56.058494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:56.066901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:56.068383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:56.069556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-63a4adbe-9637-4e84-b83e-ae35c4003b00 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161279 Dec 17 12:42:56.070098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 367/729] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:57.022098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:57.022989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:57.035980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:57.035980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:57.035980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:57.035980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:57.063757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2d951006-3c2a-40bb-91f7-eabe0787da18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Dec 17 12:42:57.064321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 363/730] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:57.088115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:57.088755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:57.095194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:57.095648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:57.096453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:57.096889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:57.227266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:57.235819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:57.237341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:57.238510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cddf9253-7fb9-493c-b938-6c4d9a11f869 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.154452 Dec 17 12:42:57.239085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 368/731] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:58.076029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:58.076943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:58.083615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:58.083992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:58.084766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:58.085191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:58.123290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b69c4f6f-a234-44dc-bcc6-7e6e36053561 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050991 Dec 17 12:42:58.123843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 364/732] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:58.260833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:58.261465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:58.268484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:58.268935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:58.269762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:58.270195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:58.411501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:58.424056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:58.426420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:58.428095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8cb4e348-2acd-47bc-9f72-f9f420320fc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.172235 Dec 17 12:42:58.429018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 369/733] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:42:59.134805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:59.135677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:59.141942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:59.142346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:59.143154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:59.143575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:59.172303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-70e642e7-b633-4004-bc99-7390c8823984 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Dec 17 12:42:59.172852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 365/734] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:42:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:42:59.450470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:42:59.451455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:42:59.462415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:59.463145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:59.464412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:42:59.465119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:42:59.598488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:59.607021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:59.608493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:42:59.609672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1795d4cb-8bac-4110-8e08-a148d0c3d0ca tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.165602 Dec 17 12:42:59.610233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 370/735] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:42:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:00.183854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:00.184674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:00.191237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:00.191990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:00.192789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:00.193221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:00.222650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ff0a3b80-5669-4e57-841b-39d09c00ed80 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042791 Dec 17 12:43:00.223210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 366/736] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:00.630325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:00.631104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:00.638843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:00.639365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:00.640282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:00.640784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:00.783790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:00.792430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:00.793960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:00.795149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fbc3e4cd-59d9-4231-9377-e8f9a337a2bf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.171047 Dec 17 12:43:00.795926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 371/737] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:01.236927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:01.236927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:01.242825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:01.243279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:01.244163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:01.244555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:01.274767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7206615f-29f6-48dd-8e76-df8d51314659 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Dec 17 12:43:01.275328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 367/738] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:01.819035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:01.820048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:01.828232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:01.828684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:01.829861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:01.830293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:01.962296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:01.970685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:01.972180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:01.973341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1292d9d0-2d7f-4391-8af7-5c03cf3baf2f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.160584 Dec 17 12:43:01.973928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 372/739] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:02.286786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:02.287910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:02.294237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:02.294673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:02.295537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:02.296129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:02.325393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-76a50cf8-73c3-4141-9802-475e8d1a15ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Dec 17 12:43:02.325970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 368/740] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:03.001016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:03.002059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:03.012113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:03.012857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:03.014193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:03.014924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:03.151974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:03.164867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:03.167414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:03.168567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2cbd0ae4-4d1d-4015-8ecf-c8cbf3cc26c8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174392 Dec 17 12:43:03.169125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 373/741] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:03.337062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:03.337995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:03.344538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:03.344934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:03.345775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:03.346199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:03.374406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-14011d4e-ea01-4a0c-822f-a303acd29eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Dec 17 12:43:03.374955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 369/742] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:04.190847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:04.191718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:04.201323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:04.201769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:04.202537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:04.202960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:04.337985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:04.346654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:04.348137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:04.349310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-803ee160-9930-4ffb-a720-82024f795aea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164850 Dec 17 12:43:04.349903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 374/743] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:04.385904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:04.387023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:04.393829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:04.394281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:04.395061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:04.395495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:04.424830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9561e3da-7a4f-49b4-8568-fb1af8f68146 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042868 Dec 17 12:43:04.425485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 370/744] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:05.371262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:05.372249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:05.382943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:05.383688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:05.384967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:05.385765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:05.436646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:05.437084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:05.443522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:05.443719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:05.444697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:05.445316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:05.475400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b99e26eb-51b6-482c-8569-252e38fb0293 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Dec 17 12:43:05.475970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 371/745] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:43:05.516277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:05.529546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:05.531842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:05.533550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6818a127-f35f-4a7b-8d92-b066ec0e17c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.168286 Dec 17 12:43:05.534282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 375/746] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:06.486576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:06.487574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:06.495191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:06.495658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:06.496539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:06.496974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:06.526681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d79e484-e839-4bf0-a7b6-7dfaea81f0f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Dec 17 12:43:06.527336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 372/747] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:06.558424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:06.559108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:06.565518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:06.565942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:06.566712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:06.567147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:06.701069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:06.713501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:06.715579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:06.716715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ee2df3e0-9791-4f56-8faf-5824e4822023 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164428 Dec 17 12:43:06.717289 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 376/748] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:07.538453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:07.539364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:07.545992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:07.546409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:07.547403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:07.547836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:07.577651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0d7720b8-98b8-4ab6-b10c-fdc0bad08d5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 Dec 17 12:43:07.578205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 373/749] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:07.738537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:07.739559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:07.750365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:07.751106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:07.752379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:07.753091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:07.895012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:07.908036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:07.918270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:07.919741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99db21ad-bf0e-4459-87ec-0940d98c4813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.187435 Dec 17 12:43:07.920515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 377/750] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:08.589296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:08.590294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:08.596999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:08.597533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:08.598319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:08.598757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:08.628776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2cc88d4a-e004-4d7e-ada2-7691a5dd95a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Dec 17 12:43:08.629372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 374/751] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:08.941557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:08.942511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:08.953142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:08.953926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:08.955560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:08.956269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:09.319055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:09.327249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:09.328722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:09.330240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4bbca35-0f6a-40af-add1-eb152a99916a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.394972 Dec 17 12:43:09.330798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 378/752] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:09.639925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:09.640833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:09.647461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:09.647902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:09.648672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:09.649098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:09.679348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-56f0799b-1df3-433f-ba1e-ce61ae511491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Dec 17 12:43:09.679883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 375/753] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:10.351839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:10.352818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:10.363323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:10.364068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:10.365335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:10.366107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:10.501107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:10.513810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:10.516199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:10.518058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b62ac420-15e3-47e1-bf23-e05d1bd9ace3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.172405 Dec 17 12:43:10.518929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 379/754] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:10.691341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:10.692433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:10.699699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:10.700278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:10.701058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:10.701529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:10.731652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b7f2e210-ffec-449a-aef7-a756071f6ebe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044387 Dec 17 12:43:10.732211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 376/755] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:11.543601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:11.544705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:11.555286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:11.556010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:11.557320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:11.558057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:11.695402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:11.704015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:11.705874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:11.707017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-197b2e3a-fce5-4f90-980f-f203a8b1a55c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.169701 Dec 17 12:43:11.707802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 380/756] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:11 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:11.743208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:11.744207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:11.750595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:11.751040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:11.751799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:11.752371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:11.781439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e1f3e550-64d9-4f2c-9d76-b070e65948db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Dec 17 12:43:11.781966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 377/757] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:12.728821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:12.729802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:12.740428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:12.741162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:12.742486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:12.743195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:12.791984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:12.792906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:12.800275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:12.801539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:12.802578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:12.803227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:12.842781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8f709d28-77ea-4bc5-9cc7-5e0b52996667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054516 Dec 17 12:43:12.843353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 378/758] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:43:12.876943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:12.885218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:12.886724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:12.887928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38f0f2f0-da9a-4959-a9ec-2f5600bcf996 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.165352 Dec 17 12:43:12.888515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 381/759] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:13.853434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:13.854350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:13.863329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:13.863329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:13.863329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:13.863329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:13.892987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aa0c826c-8280-4242-a632-e63b081f6e72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Dec 17 12:43:13.893588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 379/760] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:13.911691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:13.912317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:13.919036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:13.919479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:13.920276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:13.920729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:14.054025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:14.063196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:14.064818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:14.066002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2236458b-1011-45fc-8a4b-b370fb732f0d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.158000 Dec 17 12:43:14.073559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 382/761] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:14.903985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:14.905862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:14.912381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:14.912908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:14.913781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:14.914358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:14.944022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c62be08-e0ec-44a0-8d3d-ca343e5e4298 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Dec 17 12:43:14.944571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 380/762] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:15.088683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:15.089560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:15.100090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:15.100824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:15.102151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:15.102850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:15.237139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:15.245900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:15.247368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:15.248505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1145539-d5c9-43de-b9ce-f04e94cc78c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166618 Dec 17 12:43:15.249067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 383/763] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:15.956079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:15.957840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:15.964712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:15.965164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:15.965977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:15.966404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:15.996542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1b7093cc-2f3c-4aa1-b982-af6c24f1b47d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Dec 17 12:43:15.997096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 381/764] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:16.270697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:16.271571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:16.281173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:16.281657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:16.282422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:16.282841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:16.419868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:16.428763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:16.430230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:16.431395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-519163e4-3c9f-4674-be07-16ae05ddb2e0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.167203 Dec 17 12:43:16.431921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 384/765] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:17.007986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:17.008900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:17.015410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:17.015925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:17.016710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:17.017140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:17.046754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a19892cb-85be-4f3b-9dc9-d1e794213ee1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042475 Dec 17 12:43:17.047305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 382/766] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:17.452412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:17.452979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:17.460087 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:17.460542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:17.461304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:17.461780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:17.592163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:17.600595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:17.602101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:17.603247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2004f5e-7a10-4c97-baa7-b02879568990 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.156413 Dec 17 12:43:17.603817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 385/767] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:18.058144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:18.059085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:18.065727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:18.066174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:18.066957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:18.067371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:18.097267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5862ee35-695c-4b5b-85ff-af0eaaf51fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Dec 17 12:43:18.097884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 383/768] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:18.621013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:18.621667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:18.628386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:18.628838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:18.629654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:18.630083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:18.765641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:18.774284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:18.775764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:18.776906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6486781b-63ba-4fac-80f7-2be5e4ba2748 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.159618 Dec 17 12:43:18.777507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 386/769] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:18 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:19.108130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:19.109076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:19.115759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:19.116206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:19.116986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:19.117578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:19.146662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5732051b-dfa8-4d38-923a-ffe4e932e62d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 Dec 17 12:43:19.147294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 384/770] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:19.799110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:19.800116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:19.810854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:19.811627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:19.812915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:19.813684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:19.945788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:19.954101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:19.955950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:19.957098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52d24964-10e6-4406-8954-1887a9bdd952 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164466 Dec 17 12:43:19.957688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 387/771] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:20.159090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:20.160035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:20.166652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:20.167075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:20.167845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:20.168263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:20.197428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68c05500-f59e-4b98-9979-726ceebf15e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Dec 17 12:43:20.197993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 385/772] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:20.979627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:20.980520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:20.992136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:20.992874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:20.994221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:20.994939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:21.137070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:21.146496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:21.148308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:21.149626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f8fb72e0-e983-4168-9950-b9ae8483674e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.176403 Dec 17 12:43:21.150312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 388/773] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:21.208534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:21.209633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:21.216143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:21.216593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:21.217395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:21.217855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:21.247206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fad03fad-43d3-4023-a268-0ddda6f71335 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Dec 17 12:43:21.247771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 386/774] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:22.171668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:22.172811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:22.183347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:22.184091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:22.185386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:22.186179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:22.258669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:22.260166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:22.266434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:22.266854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:22.268006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:22.268619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:22.300727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e0a7c621-8125-4ca2-96f7-67e69f7d27be tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Dec 17 12:43:22.301301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 387/775] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:22.320191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:22.328595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:22.330476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:22.331630 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8eed9d8f-f977-42c2-81d0-ab04a0436ce7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166299 Dec 17 12:43:22.332198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 389/776] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:23.311907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:23.312814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:23.319547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:23.319928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:23.320708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:23.321142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:23.349544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:23.350224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:23.351840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-04c696a4-ece3-4cf6-be78-933caa7dc44a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Dec 17 12:43:23.352403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 388/777] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:23.356787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:23.357190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:23.358076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:23.358530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:23.500796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:23.509681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:23.511162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:23.512314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a0ee993b-8a10-4cca-9881-722f0d9cf5e7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.166580 Dec 17 12:43:23.512877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 390/778] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:24.363374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:24.364314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:24.370989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:24.371405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:24.372186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:24.372616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:24.401730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61ff1005-230f-4793-af91-0d8fd63cbcf8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Dec 17 12:43:24.402301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 389/779] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:24.534370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:24.535355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:24.546119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:24.546892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:24.548176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:24.548903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:24.685753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:24.694626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:24.696107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:24.697259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-054c1172-b365-4602-a6d3-d72f41d1e6a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.169317 Dec 17 12:43:24.697858 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 391/780] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:25.413012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:25.413961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:25.420696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:25.421128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:25.421927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:25.422359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:25.451520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f58cc1c-6f8e-40e4-b482-d7b5ee2208fc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Dec 17 12:43:25.452072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 390/781] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:25.719585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:25.720518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:25.731275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:25.731997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:25.733357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:25.734135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:25.770001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:43:25.770212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:43:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 (ip 10.222.0.45) !!! Dec 17 12:43:25.864417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:25.873488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:25.875045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:25.876185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-59f82986-accc-4285-8f6a-09719bbfe3a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.162904 Dec 17 12:43:25.876718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 392/782] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:26.463133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:26.464044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:26.470686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:26.471128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:26.471900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:26.472327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:26.502250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a128d2dc-db2b-4dcc-aeea-652212dd303d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042883 Dec 17 12:43:26.502843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 391/783] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:26.895178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:26.895742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:26.904285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:26.904703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:26.905554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:26.906048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:27.037318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:27.046038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:27.047573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:27.048715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8dedcc3f-8bf0-41f2-b6cf-2262b0183006 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.157371 Dec 17 12:43:27.049293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 393/784] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:27.513823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:27.514773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:27.521714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:27.522303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:27.522966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:27.523410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:27.553591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d6862aca-9840-46b6-b4c2-7bb42b4b0247 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Dec 17 12:43:27.554153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 392/785] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:28.065903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:28.066498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:28.073238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:28.073710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:28.074568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:28.075007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:28.212091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:28.220869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:28.222390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:28.223695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bee4bfbc-6e61-455d-b07d-e20fd2b26288 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.161733 Dec 17 12:43:28.224262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 394/786] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:28.568009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:28.569496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:28.579134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:28.579583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:28.580712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:28.581140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:28.611040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f33872f-e3d3-4756-848a-d3f045557552 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049307 Dec 17 12:43:28.611737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 393/787] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:29.245585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:29.246543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:29.257098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:29.257869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:29.259127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:29.259831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:29.293595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:43:29.293827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:43:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:43:29.391431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:29.399760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:29.401220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:29.402391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c9dbe5f6-cc1e-44fb-a467-9bd429708903 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.163122 Dec 17 12:43:29.402957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 395/788] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:29.625830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:29.626779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:29.632974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:29.633660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:29.634446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:29.634881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:29.665182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-00e45832-1862-4706-9ee0-30f9a7d4c1df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045303 Dec 17 12:43:29.665784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 394/789] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:30.423999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:30.425000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:30.427933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:43:30.428195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:43:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 (ip 10.222.0.45) !!! Dec 17 12:43:30.447128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:30.447622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:30.448446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:30.448885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:30.586522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:30.595516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:30.596990 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:30.598179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-beb59670-eb82-45ca-838f-8f3ac10d4db3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.180680 Dec 17 12:43:30.598751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 396/790] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:30.680596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:30.682072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:30.690589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:30.691026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:30.691810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:30.692244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:30.722646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dd144f9e-f68f-4253-b0b8-a463ea76d160 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Dec 17 12:43:30.723506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 395/791] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:31.620531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:31.621554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:31.632125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:31.632872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:31.634211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:31.634939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:31.734545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:31.735493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:31.742877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:31.743336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:31.744203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:31.744855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:31.775959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:31.784581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:31.786111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:31.786652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61e13159-4764-48a8-a0a2-0002a6533dd1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055870 Dec 17 12:43:31.787214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 396/792] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:31.787328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-657605cb-7636-4af0-93b9-dc20dad55e0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.173104 Dec 17 12:43:31.787833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 397/793] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:31 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:32.798256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:32.799221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:32.804817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:32.806025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:32.806177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:32.806470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:32.807255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:32.807686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:32.812813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:32.813221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:32.814125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:32.814545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:32.846271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-35cfb923-4490-49bc-bddb-c19aac789cbd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051984 Dec 17 12:43:32.846829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 397/794] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:32.947242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:32.956387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:32.957901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:32.959044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d8648c4-ae2c-4ed7-bd43-45fe34e44f9c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.158003 Dec 17 12:43:32.959776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 398/795] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:32 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:33.857597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:33.858521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:33.865496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:33.865974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:33.866793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:33.867198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:33.897412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f0570ce9-d511-407d-88c4-38076d8572e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Dec 17 12:43:33.898163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 398/796] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:33.986567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:33.987632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:33.998377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:33.999113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:34.000387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:34.001122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:34.143541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:34.152135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:34.153776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:34.154938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8697e1ad-4dd2-4c4f-97e1-af2cdc517f18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.174737 Dec 17 12:43:34.155505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 399/797] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:34.909971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:34.910995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:34.917828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:34.918274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:34.919035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:34.919453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:34.954096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ade3b233-e4fa-4f18-b6f7-8396ae835ea1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Dec 17 12:43:34.954740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 399/798] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:35.177214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:35.178226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:35.188864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:35.189674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:35.190961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:35.191681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:35.344873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:35.357077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:35.358722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:35.360368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2bf775e7-6206-4b2b-88db-947939b0c4b2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.189570 Dec 17 12:43:35.360926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 400/799] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:36.083105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:36.083995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:36.090033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:36.090494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:36.091259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:36.091684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:36.121300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afb24845-ae3c-4524-9821-6745a4d94b58 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158194 Dec 17 12:43:36.121881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 400/800] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:36.383092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:36.383952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:36.394759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:36.395534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:36.396807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:36.397590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:36.529793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:36.538155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:36.539635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:36.540791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-15e4d9f9-3566-4d9f-bc89-2535384a5f5a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.164386 Dec 17 12:43:36.541402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 401/801] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:37.137421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:37.138814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:37.149502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:37.150251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:37.151529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:37.152246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:37.184293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fd15feec-5ffe-4373-99f8-ef2801ec04bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053378 Dec 17 12:43:37.184837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 401/802] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:37.568517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:37.569536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:37.580621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:37.581688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:37.582583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:37.583039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:37.726566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:37.735161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:37.736649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:37.737873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e581060-6ca1-4467-89c0-f5fa5515328c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1754 microversion: 2.20 time: 0.175860 Dec 17 12:43:37.738435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 402/803] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:38.195953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:38.196867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:38.203666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:38.204109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:38.204881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:38.205686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:38.235517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b3afb5d1-a9c0-4d24-964a-21f952c76f64 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Dec 17 12:43:38.235975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 402/804] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:38.760126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:38.761180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:38.771875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:38.772517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:38.773835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:38.774551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:38.915544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:38.923799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:38.925307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:38.926546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2bc9d4a5-cc5e-474e-bcd0-a922e880a276 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.172706 Dec 17 12:43:38.927110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 403/805] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:39.250949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:39.252414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:39.260118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:39.260566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:39.261391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:39.261825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:39.292755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac04337e-d42b-4a54-8240-b5d5889a82e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048186 Dec 17 12:43:39.293326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 403/806] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:39.948717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:39.949826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:39.959612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:39.960091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:39.960867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:39.961263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:40.093647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:40.101924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:40.103389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:40.104522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ade7450b-243a-4234-9ab0-e4fb32814e93 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162051 Dec 17 12:43:40.105052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 404/807] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:40.308129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:40.309647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:40.318986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:40.319432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:40.320205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:40.320635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:40.350281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-115516c0-7aa8-4bcf-b5e5-6ce90f744b72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Dec 17 12:43:40.350789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 404/808] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:41.130796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:41.131427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:41.138610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:41.139055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:41.139833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:41.140261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:41.275194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:41.283408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:41.284872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:41.286040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d32e4fec-8f5c-4062-b5ee-7824065f7bf5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161449 Dec 17 12:43:41.286600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 405/809] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:41.364693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:41.365678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:41.372266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:41.372711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:41.373518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:41.373946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:41.403321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7291a93d-75da-463c-9962-1c1ed40e1e9d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Dec 17 12:43:41.403801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 405/810] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:42.308376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:42.309349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:42.318242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:42.318684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:42.319518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:42.319944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:42.415040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:42.415956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:42.422792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:42.423172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:42.423956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:42.424378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:42.454539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-657f3947-3d01-42a3-b18b-454d218f2bbb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Dec 17 12:43:42.457484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 406/811] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:42.460881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:42.469750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:42.471247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:42.472392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3162a632-dcb7-46a7-99f8-2b9502f48b95 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171280 Dec 17 12:43:42.473048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 406/812] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:43.470362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:43.471705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:43.482390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:43.483147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:43.484455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:43.485166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:43.492135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:43.492726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:43.499347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:43.499795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:43.500574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:43.501000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:43.516165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c4675054-a038-4bdd-9ac5-210d6e60150c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052191 Dec 17 12:43:43.516737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 407/813] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:43.638080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:43.646707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:43.648183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:43.649314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-14aea4e6-91a6-4da6-9f3a-93972e4c9ee3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161420 Dec 17 12:43:43.649903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 407/814] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:44.531808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:44.533315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:44.540827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:44.541300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:44.542078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:44.542513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:44.571349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-28bf942f-7c33-4e78-8979-06df61163be4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Dec 17 12:43:44.571898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 408/815] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:44.678817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:44.679832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:44.690445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:44.691217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:44.692367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:44.692804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:44.832902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:44.844284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:44.846558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:44.848321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25953714-7144-47e9-8d86-b93d0ea73610 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.175365 Dec 17 12:43:44.848882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 408/816] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:45.588385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:45.589820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:45.599748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:45.600194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:45.600979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:45.601445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:45.630687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a743bdb3-419e-4ce3-a0c7-1fccc44faea0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Dec 17 12:43:45.631244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 409/817] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:45.866864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:45.867367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:45.874163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:45.874604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:45.875377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:45.875812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:46.006112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:46.015004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:46.016476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:46.017652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a8696ff-b944-4619-ad02-5ba8e68cb913 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.154710 Dec 17 12:43:46.018215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 409/818] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:45 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:46.645829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:46.646759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:46.654312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:46.654808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:46.655659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:46.656128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:46.688082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fab9e8d0-0205-499a-8027-e6d8aa8b6804 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048459 Dec 17 12:43:46.688632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 410/819] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:47.041487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:47.042045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:47.048494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:47.048926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:47.049728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:47.050152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:47.183603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:47.196335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:47.198659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:47.200480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-625d0a25-9d9b-460f-9d74-93067bcd5604 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162516 Dec 17 12:43:47.201145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 410/820] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:47.705649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:47.707128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:47.717922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:47.718652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:47.719910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:47.720766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:47.750344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e88c273a-54d1-4cf6-ab12-3b3b7f8c9263 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051273 Dec 17 12:43:47.750913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 411/821] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:48.225336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:48.226210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:48.236819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:48.237616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:48.239032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:48.239471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:48.372167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:48.380802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:48.382313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:48.383460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c8946551-787a-47fb-9d49-0f37993d73a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164450 Dec 17 12:43:48.384015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 411/822] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:48.765178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:48.766704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:48.774936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:48.775420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:48.776200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:48.776635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:48.806067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0d17f6aa-d61e-445e-93a5-012d63596a37 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Dec 17 12:43:48.806656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 412/823] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:49.405533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:49.406139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:49.416625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:49.417359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:49.418657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:49.419372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:49.559998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:49.572489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:49.574839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:49.576510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ec06f422-3699-4d1f-ac63-102468b152d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.177353 Dec 17 12:43:49.577315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 412/824] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:49.820033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:49.820949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:49.827810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:49.828258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:49.829043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:49.829519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:49.858750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0561db6e-e8f0-476b-b504-e7d645ab3d63 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Dec 17 12:43:49.859297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 413/825] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:50.599026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:50.599630 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:50.606426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:50.606859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:50.607633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:50.608064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:50.737255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:50.745655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:50.747120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:50.748418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2b92d312-8448-4a4e-8af7-98c649ad5f82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155650 Dec 17 12:43:50.748966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 413/826] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:50 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:50.870387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:50.871382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:50.881167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:50.881649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:50.882426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:50.882850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:50.924051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c0c6bb39-752b-48df-9dc8-ca6c6ec36954 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057162 Dec 17 12:43:50.924794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 414/827] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:51.769756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:51.770753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:51.777649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:51.778102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:51.778909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:51.779520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:51.911632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:51.923880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:51.926188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:51.927913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-85aa200b-48a1-458c-8d10-71dd34c62e72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164039 Dec 17 12:43:51.928449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 414/828] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:51 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:51.935908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:51.936851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:51.943399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:51.943843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:51.944621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:51.945054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:51.973778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f231ddaf-2a26-49da-8736-9f45db10ecb7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Dec 17 12:43:51.974556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 415/829] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:52.802992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:43:52.803364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:43:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:43:52.947469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:52.948442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:52.958723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:52.959403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:52.960583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:52.961210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:52.984929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:52.985999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:52.992642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:52.993090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:52.993916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:52.994344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:53.023187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ed9ba1ba-35b8-432a-8b67-675f4b5d0acf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Dec 17 12:43:53.023753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 416/830] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:53.095682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:53.104002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:53.105517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:53.106660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4b3016f1-5583-4c8c-9fab-5191a8fb17a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164509 Dec 17 12:43:53.107229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 415/831] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:54.038854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:54.040306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:54.050975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:54.051713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:54.053033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:54.053509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:54.082785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7fb7a0e-c83c-488c-a6e7-9b70ae815f26 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Dec 17 12:43:54.083270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 417/832] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:54.124034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:54.124631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:54.131204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:54.131640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:54.132396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:54.132833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:54.265335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:54.279365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:54.281840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:54.283693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d929b5db-7cdb-40a6-ae67-d8b2de66cbb1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163225 Dec 17 12:43:54.284567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 416/833] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:55.098146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:55.099599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:55.106471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:55.106908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:55.107678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:55.108103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:55.137217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20269eec-ffca-45ce-9147-69581003f772 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Dec 17 12:43:55.137810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 418/834] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:55.306100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:55.306946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:55.317156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:55.317918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:55.319061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:55.319489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:55.454892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:55.463668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:55.465134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:55.466303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1acf1d6-d569-4a1a-8689-4e9e67f7a96a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166493 Dec 17 12:43:55.466861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 417/835] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:56.152022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:56.153514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:56.164141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:56.164916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:56.166240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:56.167188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:56.200444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a247a23-e4b6-44f3-9667-498cf52f9237 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054912 Dec 17 12:43:56.200992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 419/836] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:56.487871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:56.488866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:56.499452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:56.500183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:56.501640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:56.502351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:56.635739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:56.644143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:56.645659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:56.646815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d672f8f1-dfd3-4a0f-b4ba-b2276e5fd0e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165163 Dec 17 12:43:56.647372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 418/837] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:57.212810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:57.214395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:57.221129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:57.221616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:57.222582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:57.223015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:57.252250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a0e51762-2289-493d-9963-251d0f27090d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Dec 17 12:43:57.252993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 420/838] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:57.668169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:57.669171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:57.679047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:57.679480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:57.680261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:57.680795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:57.821837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:57.831013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:57.832509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:57.833705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-54e41563-14c0-49ff-9416-54c3d78e57b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.172370 Dec 17 12:43:57.834316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 419/839] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:58.267467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:58.268973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:58.279408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:58.280137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:58.281476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:58.282186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:58.315534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2080402c-8f7f-442a-bfe8-2bc555362f77 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054339 Dec 17 12:43:58.316097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 421/840] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:43:58.853005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:58.853635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:58.860264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:58.860700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:58.861504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:58.861934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:58.993032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:59.001610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:59.003080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:43:59.004224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2553ca5f-6881-4cb4-9fbc-371806d7023b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155472 Dec 17 12:43:59.004788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 420/841] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:43:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:43:59.332097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:43:59.333550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:43:59.340474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:59.340941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:59.341860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:43:59.342240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:43:59.372330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b75354a3-fadd-4506-956e-97f543cd3fb3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Dec 17 12:43:59.372883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 422/842] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:43:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:00.022937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:00.023561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:00.030489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:00.030935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:00.031711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:00.032141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:00.165820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:00.174499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:00.175962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:00.177103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3b8d7077-4c02-47d6-acf9-e1d1663fc360 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158457 Dec 17 12:44:00.177694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 421/843] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:00.388131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:00.389495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:00.400291 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:00.401038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:00.402385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:00.403100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:00.435864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4174032b-5101-476c-be90-055271722935 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054210 Dec 17 12:44:00.436418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 423/844] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:01.194560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:01.195144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:01.202423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:01.202867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:01.203626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:01.204073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:01.334022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:01.342788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:01.344247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:01.345422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a6fd527f-277f-476d-9fa5-79dc92d10ccb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.154733 Dec 17 12:44:01.345982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 422/845] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:01.451058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:01.452288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:01.459428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:01.459869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:01.460645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:01.461064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:01.490117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3efc22e1-8eb4-45f5-97dc-997ea76cc1e1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Dec 17 12:44:01.490705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 424/846] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:02.363804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:02.364406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:02.371055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:02.371503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:02.372281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:02.372712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:02.501693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:02.502602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:02.508663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:02.509246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:02.509799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:02.510554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:02.510968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:02.518381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:02.519854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:02.521013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d8dd9d73-10e7-47ab-a47a-a7703840f2c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160945 Dec 17 12:44:02.521592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 423/847] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:02.540574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f778d7ec-66d5-4a89-aec8-746fae6db3f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Dec 17 12:44:02.541059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 425/848] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:03.543112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:03.544078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:03.554172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:03.554907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:03.555665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:03.556423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:03.556878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:03.557111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:03.567560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:03.568275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:03.569265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:03.569742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:03.600307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26ce9cc1-1f52-41a7-80e3-d0ab7fc0c2dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050951 Dec 17 12:44:03.600800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 426/849] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:03.694570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:03.703254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:03.704732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:03.706276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e87db93-6840-42a8-aa7b-b6ba40f1f7f3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169422 Dec 17 12:44:03.706841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 424/850] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:04.615813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:04.617098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:04.625370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:04.625944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:04.626917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:04.627464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:04.660360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-29c651c8-f3e4-41b9-8502-4262d05ce582 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050853 Dec 17 12:44:04.660833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 427/851] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:04.728063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:04.729100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:04.739580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:04.740307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:04.741622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:04.742325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:04.880032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:04.888817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:04.890327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:04.891464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c883d67-d20f-4da8-9703-cf6de38a2791 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169703 Dec 17 12:44:04.892016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 425/852] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:05.672297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:05.673204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:05.679914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:05.680358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:05.681110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:05.681564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:05.710999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bcb1cd87-68df-4b20-99da-f4cf67c68511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042475 Dec 17 12:44:05.711472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 428/853] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:05.909079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:05.909707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:05.916344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:05.916780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:05.917587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:05.918014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:06.052859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:06.061334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:06.062834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:06.063994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-18790f3d-a6ed-468d-a36a-53d4c1702dbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158646 Dec 17 12:44:06.064558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 426/854] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:06.726793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:06.728257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:06.738962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:06.739706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:06.741073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:06.741536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:06.770271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b17e863a-93a2-47af-ba50-dc540d7b404c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049820 Dec 17 12:44:06.770745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 429/855] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:07.091426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:07.092419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:07.102132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:07.102585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:07.103361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:07.103795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:07.244158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:07.253734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:07.255223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:07.256374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f0fea7a-2584-4382-8f32-ba370d107a5b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171175 Dec 17 12:44:07.257064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 427/856] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:07.785154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:07.786673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:07.793895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:07.794341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:07.795116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:07.795522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:07.824894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d760bb45-a66e-4469-9cae-c2735250f75c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Dec 17 12:44:07.825917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 430/857] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:08.275642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:08.276254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:08.283463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:08.283881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:08.284681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:08.285115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:08.413064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:08.421362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:08.422841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:08.423955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2cc1a527-e681-4488-88bb-fcbf2f34cbd0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.152753 Dec 17 12:44:08.424550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 428/858] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:08.837435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:08.838350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:08.845084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:08.845927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:08.846328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:08.846767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:08.881823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26654ff2-98c0-45fa-a647-c6b7da6436e0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048570 Dec 17 12:44:08.882329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 431/859] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:09.446359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:09.447379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:09.458405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:09.459131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:09.460405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:09.461109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:09.612792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:09.622713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:09.624209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:09.625405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-71849fb0-e12b-4e96-a03b-e19cdd32ec9e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.185507 Dec 17 12:44:09.625965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 429/860] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:09.897646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:09.898836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:09.906611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:09.906788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:09.907670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:09.908159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:09.939665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-40b8cb91-f4b2-4b00-8351-33fe89e23a74 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Dec 17 12:44:09.940224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 432/861] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:10.647431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:10.648350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:10.656134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:10.656652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:10.657605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:10.658155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:10.794299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:10.804874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:10.806689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:10.808420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ad3fa7ba-3e77-414d-8b4b-bdcbfaa9814d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167032 Dec 17 12:44:10.809366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 430/862] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:10.955546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:10.957335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:10.968094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:10.968836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:10.970206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:10.970927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:11.001579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c0ed83d7-91f6-461a-b826-f12f89950d3d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052518 Dec 17 12:44:11.002109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 433/863] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:11.826214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:11.826620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:11.833553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:11.833992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:11.834763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:11.835212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:11.981522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:11.990237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:11.991748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:11.992887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9442e605-3e70-438e-b0f7-ec19e947cbb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.170555 Dec 17 12:44:11.993478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 431/864] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:11 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:12.013183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:12.014132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:12.020786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:12.021167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:12.021983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:12.022409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:12.051470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b51836b9-ca57-43d2-b5b9-d94d8454144f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 Dec 17 12:44:12.052022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 434/865] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:13.014815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:13.015807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:13.026334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:13.027071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:13.028345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:13.029053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:13.062881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:13.063789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:13.070322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:13.070768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:13.071542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:13.071973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:13.101349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-14195392-de77-40de-9e55-9c9daf3b2795 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041880 Dec 17 12:44:13.101847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 435/866] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:44:13.162557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:13.171434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:13.172951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:13.174134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb383122-70a1-4852-9725-1534d750c887 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165634 Dec 17 12:44:13.174694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 432/867] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:14.116500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:14.117620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:14.124195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:14.124669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:14.125529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:14.125992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:14.154962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-605570c0-8504-4537-bd6c-0eb054b79f21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Dec 17 12:44:14.155521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 436/868] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:14.192231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:14.192803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:14.199374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:14.199819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:14.200595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:14.201027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:14.341427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:14.350210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:14.351740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:14.352897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e55067e8-e5ca-4121-825c-68ca3fd08997 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164476 Dec 17 12:44:14.353484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 433/869] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:15.169245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:15.170289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:15.178426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:15.178981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:15.179943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:15.180489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:15.213092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ef0a9879-730a-4699-966f-673f39436c8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Dec 17 12:44:15.213684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 437/870] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:15.374914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:15.375915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:15.385461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:15.385932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:15.386714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:15.387143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:15.529685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:15.542370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:15.543832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:15.544964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7041482e-6849-4dcc-be0f-d2b264badae6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.176720 Dec 17 12:44:15.545553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 434/871] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:16.228943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:16.230308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:16.240947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:16.241747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:16.243063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:16.243776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:16.279141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-23ecca3d-07f4-4ed0-bdd1-7922797c777e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056843 Dec 17 12:44:16.279709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 438/872] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:16.570325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:16.571285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:16.582380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:16.583138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:16.584387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:16.585114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:16.717836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:16.729407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:16.730888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:16.732027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f908751-fe9f-4707-901f-82c76fa16465 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167866 Dec 17 12:44:16.732587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 435/873] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:17.294239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:17.295704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:17.305974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:17.306424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:17.307207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:17.307640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:17.337569 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1b5c5442-b788-4112-bd7b-8a619d050cae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049663 Dec 17 12:44:17.338050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 439/874] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:17.754049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:17.754881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:17.762824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:17.763269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:17.764040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:17.764472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:17.903424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:17.911675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:17.913152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:17.914328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3ddf1ec-15e0-4092-aac8-975c9e3c995f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166648 Dec 17 12:44:17.914893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 436/875] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:18.353140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:18.354510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:18.365153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:18.365943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:18.367207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:18.367918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:18.402763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cd6bca5b-46ef-4037-aaf7-a57b08a65ba8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056171 Dec 17 12:44:18.403332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 440/876] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:18.935755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:18.936740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:18.946811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:18.947247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:18.948011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:18.948433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:19.089698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:19.098147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:19.099682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:19.100821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e65784a9-eca3-43c7-a592-b3843afa4cd8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171398 Dec 17 12:44:19.101410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 437/877] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:18 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:19.418539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:19.419861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:19.430508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:19.430979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:19.431750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:19.432180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:19.461545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3eef07cf-c22b-4496-abb3-1f7c95374ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049442 Dec 17 12:44:19.462103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 441/878] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:20.123158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:20.124004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:20.134812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:20.135591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:20.136899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:20.137664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:20.272504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:20.281295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:20.282782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:20.283928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bcd5d5ed-6113-4cc4-a08b-1847b9755749 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167072 Dec 17 12:44:20.284489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 438/879] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:20.477307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:20.478375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:20.486490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:20.487047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:20.488000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:20.488567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:20.520869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-df06d0f1-0b65-44d6-bc53-5e607c933196 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050231 Dec 17 12:44:20.521710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 442/880] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:21.304119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:21.304741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:21.314781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:21.315420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:21.316577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:21.317197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:21.445825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:21.454598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:21.456416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:21.457585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cbc43e28-a450-456a-a82b-4f8500f17998 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159515 Dec 17 12:44:21.458132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 439/881] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:21.537672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:21.538963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:21.545710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:21.546136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:21.546918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:21.547343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:21.575136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cede0554-f3a0-4476-8eac-0c1739175110 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Dec 17 12:44:21.575704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 443/882] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:22.479283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:22.480253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:22.490910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:22.491635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:22.492898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:22.493319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:22.587165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:22.588098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:22.594736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:22.595149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:22.596141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:22.596569 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:22.624080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:22.625608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-13b28dc3-c469-4f68-b1e0-a68acb70824b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042442 Dec 17 12:44:22.626176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 444/883] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:44:22.632930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:22.634463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:22.635615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6ab3ea10-beaf-4a26-b750-e5dce7475963 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162653 Dec 17 12:44:22.636136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 440/884] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:23.638842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:23.639886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:23.647981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:23.648535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:23.649531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:23.650057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:23.654635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:23.655388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:23.663235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:23.663832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:23.664750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:23.665321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:23.682693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0013d319-9192-4297-8439-f888fd653a2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048721 Dec 17 12:44:23.683239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 445/885] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:23.799902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:23.809847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:23.811328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:23.812607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8bfe74bc-84c6-4bb7-b696-adbaaaf8e22c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162504 Dec 17 12:44:23.817494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 441/886] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:24.698408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:24.699809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:24.710783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:24.711596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:24.712386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:24.712820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:24.741994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c4d348dc-326c-4292-9474-af318c649487 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050133 Dec 17 12:44:24.742603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 446/887] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:24.832775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:24.833683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:24.841143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:24.841621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:24.842400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:24.842829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:24.972057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:24.981209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:24.982718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:24.983847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ad6d3642-fccf-4a6e-b60f-bc41e0c93861 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.156572 Dec 17 12:44:24.984404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 442/888] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:25.758321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:25.759317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:25.766573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:25.767063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:25.767913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:25.768383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:25.799727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-65d9ab28-19d1-4c06-bada-10f6a5f68f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Dec 17 12:44:25.800264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 447/889] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:26.004286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:26.004900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:26.012795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:26.013178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:26.013982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:26.014411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:26.154370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:26.167290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:26.169100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:26.170808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f25c0fda-1dbc-4253-a1fe-d12c6dc28940 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.172138 Dec 17 12:44:26.171611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 443/890] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:26.811747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:26.812573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:26.819264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:26.819724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:26.820512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:26.820972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:26.850106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-63fa2962-3e30-4428-8622-36a72985b32a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042218 Dec 17 12:44:26.850666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 448/891] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:27.196251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:27.196863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:27.204545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:27.205062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:27.205998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:27.206845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:27.339173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:27.347468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:27.348956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:27.350135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6cec040-0f27-4215-afaa-89e6d63cd5f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160327 Dec 17 12:44:27.350703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 444/892] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:27 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:27.861845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:27.862665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:27.869307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:27.869758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:27.870524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:27.870948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:27.900559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f765d598-6efa-4af5-b750-0066e26b0cac tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 Dec 17 12:44:27.901109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 449/893] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:28.372141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:28.373107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:28.383916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:28.384658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:28.386283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:28.387011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:28.528301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:28.539023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:28.541324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:28.543059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ded883f3-af16-4c5a-abbb-a1ee381b042b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.177268 Dec 17 12:44:28.543842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 445/894] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:28.917132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:28.918561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:28.928429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:28.929116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:28.930559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:28.931014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:28.968823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a935fb6-9700-4eba-8920-16142056fab0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057462 Dec 17 12:44:28.969633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 450/895] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:29.565578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:29.566493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:29.575502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:29.575944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:29.576720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:29.577153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:29.716050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:29.724767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:29.726282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:29.727430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc582342-7204-4f0e-ae6b-972c1bd73593 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168374 Dec 17 12:44:29.727960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 446/896] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:29.980806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:29.981799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:29.988403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:29.988872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:29.989692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:29.990219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:30.018923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afdcc012-1e58-4f9f-a59f-478c8d3ebac3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Dec 17 12:44:30.019471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 451/897] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:30.747041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:30.747614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:30.754380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:30.754831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:30.755611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:30.756050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:30.883959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:30.892360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:30.893895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:30.895045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33b3f3d9-d36b-4e95-a287-e249a40be846 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.152709 Dec 17 12:44:30.895616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 447/898] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:31.032696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:31.034162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:31.040949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:31.041526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:31.042300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:31.042724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:31.071786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3bb6138d-2992-4527-9dc2-3228f0fa1cc4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Dec 17 12:44:31.072340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 452/899] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:31.916852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:31.917600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:31.925317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:31.925872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:31.926772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:31.927281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:32.066836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:32.079250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:32.080862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:32.082391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afc69518-bea4-49b0-a1f4-87fa8cbee01a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171804 Dec 17 12:44:32.082953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 448/900] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:31 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:32.085878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:32.086827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:32.093254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:32.093739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:32.094515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:32.094950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:32.123422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-622fde84-10a1-4ae4-8a3f-889e52b35aa3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Dec 17 12:44:32.123986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 453/901] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:44:33.100541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:33.101092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:33.108393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:33.108814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:33.109644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:33.110068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:33.135196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:33.136218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:33.142886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:33.143338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:33.144188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:33.144629 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:33.174649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4916806f-16eb-4827-a135-d1be0edde2df tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Dec 17 12:44:33.175225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 454/902] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:33.241055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:33.255100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:33.257559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:33.258771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-019dfce6-aa9a-4032-ade9-c63219349929 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162310 Dec 17 12:44:33.259324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 449/903] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:34.186341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:34.187150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:34.193883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:34.194331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:34.195099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:34.195522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:34.225183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8654061a-10f9-4369-9d3a-6ad15afa6a44 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Dec 17 12:44:34.225770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 455/904] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:34.280550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:34.281761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:34.292052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:34.292991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:34.294282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:34.295043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:34.431909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:34.440590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:34.442057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:34.443211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-379bf26c-0576-4dd0-98c3-2d4b1da8e673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169050 Dec 17 12:44:34.443815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 450/905] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:34 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:35.240992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:35.242371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:35.250502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:35.250940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:35.251707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:35.252131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:35.281317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6e75cccd-a8cc-4988-b4ff-34e44b6234d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Dec 17 12:44:35.281882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 456/906] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:35.465442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:35.466465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:35.477011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:35.477819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:35.479095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:35.479810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:35.622297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:35.634280 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:35.635793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:35.637007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6480f4ee-d340-4c75-a68e-2826ed46a010 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.177954 Dec 17 12:44:35.637829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 451/907] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:36.296271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:36.297861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:36.308533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:36.309320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:36.310612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:36.311325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:36.345929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3c764208-6e9b-4a99-9cad-0ec4cc9238d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056060 Dec 17 12:44:36.346489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 457/908] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:36.659164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:36.659980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:36.671197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:36.672239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:36.673638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:36.674405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:36.808839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:36.817550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:36.819041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:36.820221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-01dfdc02-8c1e-412f-a871-9771aa7278e8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167441 Dec 17 12:44:36.820789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 452/909] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:37.361978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:37.363367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:37.372928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:37.373413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:37.374195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:37.374628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:37.405565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bf871af9-0da3-46c8-9495-2204ec513288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050218 Dec 17 12:44:37.406115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 458/910] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:37.839939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:37.840612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:37.847956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:37.848450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:37.849323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:37.849822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:37.984987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:37.993533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:37.995020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:37.996279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-03f5c188-f970-43c2-96ce-d5f189e764e3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160445 Dec 17 12:44:37.996817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 453/911] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:38.420193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:38.421568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:38.432253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:38.432972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:38.434289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:38.434993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:38.469619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0cc31cad-9f11-48d4-90fc-e50b2bc42ba2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055941 Dec 17 12:44:38.470162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 459/912] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:39.023728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:39.024780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:39.032887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:39.033244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:39.034283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:39.034731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:39.163089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:39.171693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:39.173176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:39.174347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0beb509b-e130-4524-8aea-f1e6f05d5a4b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.156955 Dec 17 12:44:39.174901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 454/913] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:39.485381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:39.486780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:39.497635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:39.498083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:39.498870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:39.499301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:39.527726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e68c4606-52a8-4e06-a097-ff16574437c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048852 Dec 17 12:44:39.528310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 460/914] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:40.196040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:40.196917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:40.208304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:40.209018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:40.210385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:40.211110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:40.349845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:40.363133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:40.365571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:40.367343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a8bc862-a0c5-4ee2-8e91-1e0d439e1b15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.177433 Dec 17 12:44:40.368090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 455/915] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:40 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:40.543143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:40.545553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:40.552504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:40.552948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:40.553759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:40.554185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:40.585543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a13807e7-947e-4219-b6cd-25b7fc8d53ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048530 Dec 17 12:44:40.586099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 461/916] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:41.391143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:41.392104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:41.403191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:41.403917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:41.405178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:41.405925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:41.556921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:41.565883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:41.568629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:41.569830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0498265e-7355-445a-aa41-b709f7bb877a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.185101 Dec 17 12:44:41.570400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 456/917] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:41.601858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:41.603440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:41.611408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:41.611846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:41.612611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:41.613037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:41.642318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66d517a8-5482-4667-9c7d-20bce1b0733c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Dec 17 12:44:41.642884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 462/918] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:42.592494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:42.593219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:42.601907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:42.602497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:42.603580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:42.604152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:42.653817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:42.654792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:42.661195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:42.661672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:42.662446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:42.662878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:42.693017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5276589d-f789-4058-bb42-2165f91d3bd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Dec 17 12:44:42.693662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 463/919] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:42.739454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:42.748023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:42.750123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:42.750690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d2c4f3d-0a7c-41d4-b26f-5a47439211f7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164420 Dec 17 12:44:42.751255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 457/920] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:43.709215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:43.710585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:43.721190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:43.722025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:43.723285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:43.723985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:43.756700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1340d017-704b-4ad0-ac91-22ba185df3e3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054362 Dec 17 12:44:43.757240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 464/921] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:43.767952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:43.768525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:43.775205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:43.775647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:43.776389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:43.776815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:43.911180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:43.922520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:43.924007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:43.925165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-49a459a8-eca7-406d-8bba-a0cbee1a243d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160941 Dec 17 12:44:43.925758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 458/922] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:44.772780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:44.774136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:44.782784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:44.783225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:44.784026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:44.784476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:44.814276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0c4d2473-ed89-48f6-be66-e698013605af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048012 Dec 17 12:44:44.814831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 465/923] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:44.947112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:44.948206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:44.959128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:44.959877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:44.961156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:44.961922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:45.091057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:45.099870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:45.101407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:45.102559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06139f3d-fe87-4feb-832f-747f1fc00421 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161749 Dec 17 12:44:45.103125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 459/924] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:45.828625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:45.829586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:45.836596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:45.837039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:45.837844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:45.838266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:45.867665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6f4f4282-e032-408b-b6a6-13f7a3c54418 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Dec 17 12:44:45.868223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 466/925] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:46.124395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:46.125233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:46.135772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:46.136504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:46.137812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:46.138568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:46.275100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:46.283838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:46.285304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:46.286455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fc61200f-c800-4f9d-8139-19d60c07eee1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168317 Dec 17 12:44:46.287024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 460/926] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:46 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:46.883261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:46.884738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:46.893588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:46.894044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:46.894823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:46.895256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:46.924611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac5c1c11-b8d6-4fac-9642-51d265550346 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047757 Dec 17 12:44:46.925165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 467/927] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:47.304055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:47.304618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:47.311441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:47.311880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:47.312655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:47.313085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:47.450169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:47.459882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:47.461380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:47.462519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cfd26f5b-d7fa-4f25-bb93-47a4f2308d85 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162303 Dec 17 12:44:47.463076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 461/928] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:47.940236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:47.941613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:47.952051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:47.952865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:47.954183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:47.954883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:47.989804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-941ffbce-af19-46e0-9163-86ec641de596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056119 Dec 17 12:44:47.990347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 468/929] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:48.483843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:48.484774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:48.495463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:48.496203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:48.497535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:48.498276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:48.636244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:48.644601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:48.646084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:48.647237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7034fa12-3344-4762-af39-0fc76b5a7562 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169751 Dec 17 12:44:48.647802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 462/930] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:49.005488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:49.006938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:49.017269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:49.017749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:49.018527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:49.018956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:49.048300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b3f59fb0-3898-45d1-bc11-218a31148667 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049244 Dec 17 12:44:49.048865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 469/931] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:49.669750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:49.671083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:49.679395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:49.679918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:49.680822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:49.681339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:49.810428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:49.819530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:49.821057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:49.822245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac4b21d1-987b-4585-af15-cc938be1bf54 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159127 Dec 17 12:44:49.822787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 463/932] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:50.060045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:50.060954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:50.067573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:50.068017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:50.068798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:50.069232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:50.099519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8b7e057e-ea79-411b-8d9b-99e789a77100 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Dec 17 12:44:50.100097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 470/933] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:50.843044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:50.843745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:50.850445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:50.850877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:50.851633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:50.852057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:50.981414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:50.990251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:50.991727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:50.992870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e5b1839-b356-459a-88c0-b9f3f55936c4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.153616 Dec 17 12:44:50.993460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 464/934] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:50 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:51.114902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:51.116379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:51.127046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:51.127785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:51.129070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:51.130013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:51.167233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-50cf00b4-a6bd-4335-8779-14cdc95aad3f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058722 Dec 17 12:44:51.167986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 471/935] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:52.020017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:52.021045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:52.031828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:52.032615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:52.033928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:52.034651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:52.174183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:52.178785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:52.179727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:52.182637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:52.184162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:52.185342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25b66220-c75d-4514-a2b5-73b9611654df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171718 Dec 17 12:44:52.186167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 465/936] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:52.186305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:52.186920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:52.187396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:52.187848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:52.220296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d295840f-ef4d-41d6-99f5-8d7fdf42faca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Dec 17 12:44:52.220859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 472/937] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:53.206275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:53.207531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:53.217022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:53.217516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:53.218313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:53.218991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:53.231923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:53.233575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:53.250825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:53.255355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:53.256257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:53.256900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:53.287566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a83aad7e-0064-48f3-b0af-406c74ddc2a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059378 Dec 17 12:44:53.288394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 473/938] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:53.364595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:53.373145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:53.374649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:53.375789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6ce94f7-c5e5-4acb-9c74-8416fc15db62 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.175547 Dec 17 12:44:53.376413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 466/939] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:53 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:54.299583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:54.300496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:54.307060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:54.307510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:54.308292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:54.308931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:54.339310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2452a09c-2e90-408d-a65a-db2b4a4cec8a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Dec 17 12:44:54.339906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 474/940] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:54.396903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:54.397968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:54.408192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:54.408635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:54.409450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:54.409878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:54.541409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:54.550587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:54.552023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:54.553172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f36202a-5a1e-413d-8a3d-4ea61f9cb4cc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162502 Dec 17 12:44:54.553740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 467/941] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:55.351938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:55.352985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:55.360666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:55.361191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:55.362157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:55.362652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:55.394184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e68233e1-2ca4-4c21-8fa9-ab8ba06f3090 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Dec 17 12:44:55.394758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 475/942] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:55.579192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:55.579824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:55.587059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:55.587521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:55.588285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:55.588710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:55.720419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:55.729345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:55.730866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:55.732014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-09d64795-809b-444a-9d02-7bb901aea553 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159135 Dec 17 12:44:55.732589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 468/943] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:56.409710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:56.411168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:56.421735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:56.422493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:56.423564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:56.423990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:56.454980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-45a2599f-8033-4170-b93e-75196f6aa28b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051789 Dec 17 12:44:56.455543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 476/944] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:56.750384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:56.750997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:56.757816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:56.758264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:56.759048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:56.759482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:56.899459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:56.909054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:56.910505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:56.911677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-51189af6-6a9f-4384-96ad-e3f4d10dd3ad tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165188 Dec 17 12:44:56.912243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 469/945] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:57.470257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:57.471169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:57.477670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:57.478248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:57.479170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:57.479604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:57.518547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aeecf4cb-5c52-4e91-8da3-a5d896517c5a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054951 Dec 17 12:44:57.519100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 477/946] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:57.929779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:57.930589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:57.937235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:57.937812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:57.938593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:57.939046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:58.067200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:58.075735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:58.077244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:58.078472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d60bb24a-43f0-4753-bc12-0948fac661a4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.152460 Dec 17 12:44:58.079080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 470/947] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:58.530188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:58.531103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:58.537554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:58.538012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:58.538962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:58.539403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:58.569968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e5d4faa3-5e4e-4a82-8ccb-3f60fb4ba721 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Dec 17 12:44:58.570533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 478/948] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:44:59.096162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:59.096754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:59.103591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:59.104034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:59.104814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:59.105247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:59.234890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:59.243187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:59.244660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:44:59.245840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6fef7d2-f521-463e-bee8-49e13d658cb6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.153574 Dec 17 12:44:59.246399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 471/949] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:44:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:44:59.580953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:44:59.581903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:44:59.588478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:59.588952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:59.589764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:44:59.590196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:44:59.629432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3a2ead49-f207-44fe-ab2b-d782207724d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052269 Dec 17 12:44:59.629987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 479/950] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:44:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:00.266853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:00.267895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:00.275782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:00.276424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:00.277202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:00.277619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:00.411687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:00.420718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:00.422188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:00.423328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f29de2af-1223-4356-921c-5b7532e7b39f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162733 Dec 17 12:45:00.423890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 472/951] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:00.640799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:00.641867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:00.648498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:00.648946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:00.649778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:00.650238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:00.680102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-45281cb1-afb2-41c1-b7bd-4eb9ab4fe9b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Dec 17 12:45:00.680754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 480/952] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:01.445134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:01.446250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:01.456922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:01.457808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:01.458597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:01.459022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:01.596077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:01.604580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:01.606095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:01.607204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2da961d2-bbe8-41a7-92b5-93044b1bfca9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168343 Dec 17 12:45:01.607791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 473/953] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:01.691365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:01.692242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:01.698771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:01.699244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:01.700001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:01.700425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:01.729850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-85d80b24-04ef-4270-bc41-ce9cc1893c15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 Dec 17 12:45:01.730399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 481/954] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:02.625703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:02.626313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:02.632751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:02.633118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:02.633984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:02.634409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:02.741526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:02.743062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:02.750525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:02.751053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:02.751821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:02.752249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:02.767756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:02.776753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:02.778357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:02.779576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d15fe131-86f9-456b-beb2-24023782d46d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.157877 Dec 17 12:45:02.780357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 474/955] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:02.784380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0fd8282f-6990-4e4e-ad15-7f69dbeb961f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046910 Dec 17 12:45:02.784947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 482/956] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:03.795920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:03.804861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:03.804961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:03.804961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:03.805504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:03.805504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:03.805689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:03.805689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:03.805852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:03.805852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:03.806006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:03.806532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:03.838934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f89d5e6b-372d-4bdc-9ac0-6a0620469419 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046821 Dec 17 12:45:03.839538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 475/957] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:03.943231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:03.951913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:03.953419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:03.954576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3de401fa-2b29-4371-b628-f1d93af031db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161056 Dec 17 12:45:03.955137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 483/958] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:04.856617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:04.857598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:04.864113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:04.864561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:04.865373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:04.865798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:04.894178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c7bbdf1-26ad-4ec4-83da-47659c194230 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047638 Dec 17 12:45:04.894741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 476/959] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:04.975995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:04.976594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:04.983590 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:04.984033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:04.984810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:04.985242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:05.120901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:05.130097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:05.131579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:05.132723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e443f370-362f-45a0-9af0-b4270a248c13 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161828 Dec 17 12:45:05.133297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 484/960] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:05.911664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:05.912572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:05.918809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:05.919250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:05.920014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:05.920434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:05.951074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30508370-cb00-4539-bf53-b4d91b48b681 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Dec 17 12:45:05.951618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 477/961] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:06.154951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:06.155786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:06.166488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:06.167228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:06.168502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:06.169216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:06.308217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:06.317157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:06.318716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:06.319863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-da0736ad-0a00-4d9a-8c61-bfd1646e3dfd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171440 Dec 17 12:45:06.320418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 485/962] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:06.962338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:06.963325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:06.970039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:06.970490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:06.971269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:06.971701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:07.001151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2b943931-dea3-466b-ab24-b75f19cccbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Dec 17 12:45:07.001711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 478/963] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:07.340326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:07.341072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:07.349803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:07.350250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:07.351055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:07.351503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:07.482711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:07.491818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:07.493314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:07.494468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8bdb8b9c-fa56-44ed-aa63-752d492bef28 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159118 Dec 17 12:45:07.495030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 486/964] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:08.013100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:08.014131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:08.020515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:08.021152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:08.021960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:08.022391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:08.051138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-02f9cb7e-a0a4-4c3c-ade2-5cb420c3f33d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042092 Dec 17 12:45:08.051645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 479/965] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:08.516340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:08.517327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:08.527948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:08.528691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:08.530030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:08.530745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:08.662361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:08.670945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:08.672432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:08.673637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-32f2be4a-2810-434f-8b32-1b2cc14a12c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163450 Dec 17 12:45:08.674195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 487/966] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:09.062741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:09.063647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:09.070595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:09.071045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:09.071832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:09.072264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:09.101868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1dcda13-3061-40fc-bcbf-00cbc604f7d8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Dec 17 12:45:09.102409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 480/967] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:09.695687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:09.696676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:09.707246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:09.708368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:09.709521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:09.709952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:09.839604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:09.850484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:09.853534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:09.855907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cee26c4c-e3bb-4350-965c-73393b5dedff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166283 Dec 17 12:45:09.856612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 488/968] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:10.113629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:10.114543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:10.121440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:10.121889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:10.122679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:10.123111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:10.152234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-232ed595-2f83-462c-9d96-089ef6bca4c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 Dec 17 12:45:10.152795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 481/969] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:10.873922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:10.874491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:10.881197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:10.881670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:10.882437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:10.882861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:11.019005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:11.027289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:11.028733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:11.029930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-32438f8d-e06a-4bd4-97b9-5ec5a48b9138 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159772 Dec 17 12:45:11.030489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 489/970] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:11.163719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:11.164712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:11.176598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:11.176598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:11.176598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:11.176598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:11.201781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7cd72f7e-317d-4744-bfb1-a692f607d14f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Dec 17 12:45:11.202326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 482/971] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:12.051768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:12.052883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:12.061121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:12.061715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:12.062674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:12.063212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:12.200745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:12.210377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:12.211954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:12.213223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6ec6f261-b0d5-49ef-93fb-4eaa592e193c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167786 Dec 17 12:45:12.214629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:12.215203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 490/972] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:12.215598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:12.225438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:12.225438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:12.225438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:12.225438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:12.253453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4da96092-19aa-4c82-aedc-fc78528d91a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Dec 17 12:45:12.254004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 483/973] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:45:13.236486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:13.237320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:13.247501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:13.248209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:13.249555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:13.250275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:13.265374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:13.266437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:13.272922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:13.273704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:13.275207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:13.275364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:13.306295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-836da213-e5cd-4a64-996e-7486f0530b0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Dec 17 12:45:13.306872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 484/974] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:13.384999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:13.393574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:13.395060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:13.396215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c29abacf-a660-4fa5-b822-e8b28ecd1494 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166661 Dec 17 12:45:13.396775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 491/975] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:14.317856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:14.318771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:14.325324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:14.325785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:14.326601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:14.327026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:14.358489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52a8be1c-4afc-472c-a3a1-b9ed06d75511 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Dec 17 12:45:14.359031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 485/976] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:14.416739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:14.417414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:14.424107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:14.424545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:14.425308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:14.425765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:14.557642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:14.566233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:14.567732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:14.568873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8457e1d2-9ac0-49d0-a725-d5456ddb550c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.157552 Dec 17 12:45:14.569534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 492/977] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:15.370207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:15.371112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:15.377950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:15.378510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:15.379154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:15.379581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:15.408715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d009223-ce6a-4286-b931-c0fcdb466e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042430 Dec 17 12:45:15.409288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 486/978] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:15.591242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:15.592151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:15.603140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:15.603878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:15.605160 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:15.605929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:15.739290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:15.748297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:15.749778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:15.750956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-adb01dad-8777-4c73-9f41-2edc08de4bc7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166066 Dec 17 12:45:15.751515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 493/979] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:16.423827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:16.425345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:16.434353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:16.434801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:16.435586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:16.436018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:16.466780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-65e711af-6802-4ce8-b345-b4b23fe9c480 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049328 Dec 17 12:45:16.467348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 487/980] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:16.773059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:16.773956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:16.784697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:16.785501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:16.786778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:16.787494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:16.918398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:16.927436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:16.928912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:16.930086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eee028c6-8569-49ab-9476-c9c4437cd6c1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163313 Dec 17 12:45:16.930645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 494/981] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:17.481026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:17.481970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:17.488522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:17.488962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:17.489784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:17.490207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:17.519235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55d50843-00fe-4d30-86ac-3d254807c35b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 Dec 17 12:45:17.519845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 488/982] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:17.952406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:17.953338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:17.964115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:17.964555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:17.965306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:17.965777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:18.100445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:18.113534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:18.115815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:18.117621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eb20fb0f-3ef6-417a-b47e-78b047e9e3b7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171774 Dec 17 12:45:18.118295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 495/983] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:18.531243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:18.532177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:18.538900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:18.539341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:18.540113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:18.540537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:18.570028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-def328da-7770-4776-9222-250c066a84b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Dec 17 12:45:18.573876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 489/984] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:18.816940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:45:18.817301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:45:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:45:19.138733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:19.139452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:19.147940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:19.148538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:19.149612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:19.150189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:19.282133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:19.290473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:19.291963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:19.293116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5ff709b9-65b1-4dfc-a45f-0bb5f1be97d7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160214 Dec 17 12:45:19.293710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 496/985] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:19.585912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:19.587362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:19.594247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:19.594687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:19.595456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:19.596200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:19.626931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dda50b8f-becb-4265-b540-fbb73b11882a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Dec 17 12:45:19.627204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 490/986] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:20.311900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:20.312510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:20.318851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:20.319295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:20.320102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:20.320532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:20.452432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:20.465553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:20.467881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:20.469699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-992e97e7-50b6-4758-8598-03fc57272b23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161156 Dec 17 12:45:20.470490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 497/987] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:20.642149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:20.643258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:20.649788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:20.650240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:20.651073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:20.651497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:20.682627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-419af4c7-30b0-4ded-a3f4-8a2042b54077 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Dec 17 12:45:20.683140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 491/988] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:21.494197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:21.495119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:21.505815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:21.506539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:21.507806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:21.508520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:21.645118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:21.653968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:21.655448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:21.656591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3ac67b8c-d70e-4f6b-82e7-795edd03bf59 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168610 Dec 17 12:45:21.657155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 498/989] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:21.694330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:21.695240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:21.702460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:21.702908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:21.703686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:21.704111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:21.734581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31d2a8ad-2c12-432c-a884-6f568a6e83d1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Dec 17 12:45:21.735131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 492/990] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:22.678539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:22.679411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:22.690838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:22.691566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:22.692820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:22.693576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:22.745259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:22.746202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:22.752644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:22.753099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:22.753931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:22.754363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:22.785015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f04d87fb-176d-4788-adea-e18395c66fae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Dec 17 12:45:22.785637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 493/991] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:22.835825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:22.849557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:22.851809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:22.853525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-816e1785-81ca-499e-92bb-877048751c89 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.181919 Dec 17 12:45:22.854196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 499/992] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:23.796159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:23.797068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:23.803580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:23.804019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:23.812486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:23.812486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:23.836071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e68cfa4d-3f5b-4f2f-ab2a-219dfa6c7aef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Dec 17 12:45:23.836628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 494/993] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:23.871673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:23.872308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:23.879054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:23.879499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:23.880267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:23.880725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:24.013210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:24.027013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:24.028494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:24.029684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-33b9132b-3b09-4bc0-aeb3-77029e4c9c4a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.161820 Dec 17 12:45:24.030244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 500/994] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:24.847589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:24.848520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:24.855286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:24.855723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:24.856486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:24.856906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:24.886367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f1511cc-7346-4aec-a39e-eb715d134de7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Dec 17 12:45:24.886921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 495/995] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:25.051796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:25.052783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:25.063304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:25.064336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:25.065700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:25.066424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:25.198258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:25.206924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:25.208741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:25.209921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5e1ad0db-81f3-437f-9124-fa7ec6bf1d42 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164373 Dec 17 12:45:25.210484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 501/996] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:25.898000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:25.898926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:25.905148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:25.905632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:25.906440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:25.906863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:25.936818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe24e371-57c2-406d-9c5a-060d95f6a82b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Dec 17 12:45:25.937373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 496/997] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:26.232281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:26.233175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:26.243935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:26.244682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:26.245920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:26.246361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:26.381243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:26.391914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:26.393432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:26.394586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b564924b-e281-4591-8d07-471ea87f336c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168883 Dec 17 12:45:26.395160 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 502/998] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:26.947886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:26.948862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:26.955576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:26.956013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:26.956782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:26.957207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:26.987975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8886af2f-1d74-4c1c-9243-5aa9a6137200 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Dec 17 12:45:26.988513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 497/999] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:27.417801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:27.418459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:27.428072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:27.428777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:27.430187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:27.430892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:27.583902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:27.593118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:27.594622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:27.595758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f8c5e5bf-9abe-42ba-8a9a-5afbbb02c229 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.185140 Dec 17 12:45:27.596288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 503/1000] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:27 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:27.999812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:28.000735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:28.007517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:28.007957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:28.008767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:28.009185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:28.039387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a31d98c8-c26d-432b-9ffd-6d3d02388745 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Dec 17 12:45:28.039956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 498/1001] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:28.618001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:28.618954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:28.629310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:28.630089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:28.631482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:28.632134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:28.767870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:28.776181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:28.777675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:28.778810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f2327363-30fa-4e62-93c8-a7281a97a549 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167151 Dec 17 12:45:28.779362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 504/1002] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:29.059667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:29.061945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:29.070594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:29.070990 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:29.071928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:29.072353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:29.109962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e63a791d-f9af-4468-9d5b-35247646c4b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059158 Dec 17 12:45:29.110488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 499/1003] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:29.796756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:29.797411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:29.803482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:29.803923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:29.804699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:29.805339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:29.935015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:29.944138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:29.945678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:29.946831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7851d757-4c66-4922-97c7-a6bc0d8a81a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.153983 Dec 17 12:45:29.947404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 505/1004] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:30.121230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:30.122165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:30.128725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:30.129168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:30.130070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:30.130375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:30.163307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2730714-ce69-483a-bac1-2471c232c6f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045713 Dec 17 12:45:30.163831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 500/1005] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:30.970136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:30.971132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:30.982270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:30.982720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:30.983509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:30.983943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:31.119944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:31.129091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:31.130594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:31.131754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-72a5876d-9e66-40f5-9890-d8da00ec5bb0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167998 Dec 17 12:45:31.132334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 506/1006] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:31.174493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:31.175397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:31.182794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:31.183021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:31.183699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:31.184134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:31.214268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3576bf7a-fb38-4c41-9cbe-1ddbcf968d24 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Dec 17 12:45:31.214836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 501/1007] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:32.154442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:32.155121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:32.163811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:32.164402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:32.165478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:32.166055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:32.233572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:32.234572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:32.241545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:32.241984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:32.242765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:32.243186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:32.271532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dd9e8647-b33f-4edd-9f38-8cf8c5b54a6a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049474 Dec 17 12:45:32.272091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 502/1008] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:32.306328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:32.318910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:32.321352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:32.323068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1399edb9-9691-4d21-8822-4ec7a34e0950 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.174990 Dec 17 12:45:32.323825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 507/1009] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:32 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:33.283388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:33.284439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:33.291132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:33.291645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:33.292477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:33.292901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:33.323460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-05edd7d1-23df-42f3-a6cf-c3daba72fb89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Dec 17 12:45:33.324017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 503/1010] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:33.341000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:33.341619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:33.348310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:33.348746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:33.349534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:33.349957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:33.479142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:33.488138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:33.489796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:33.490866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-827e2274-3474-452d-aa66-616bf1bf5e84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.153616 Dec 17 12:45:33.491410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 508/1011] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:34.335528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:34.336627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:34.343162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:34.343593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:34.344353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:34.344783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:34.375269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b33d8222-b4c2-4a10-b84a-e6f484adfec7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Dec 17 12:45:34.375822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 504/1012] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:34.512451 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:34.513516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:34.524031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:34.524771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:34.526107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:34.526821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:34.665147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:34.674490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:34.676056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:34.677602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3e3cf91a-1d1a-4be2-b3b6-8a9b4f5762a0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171346 Dec 17 12:45:34.678159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 509/1013] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:34 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:35.388958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:35.389909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:35.396453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:35.396880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:35.397690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:35.398110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:35.427963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f20bfc53-6830-4ef0-b11c-cd9d9892e103 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Dec 17 12:45:35.428507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 505/1014] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:35.698024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:35.698588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:35.705001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:35.705484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:35.706266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:35.706700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:35.837313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:35.846136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:35.847624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:35.848784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e7686447-f460-480e-85f6-783b6b2e1ca8 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.154661 Dec 17 12:45:35.849346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 510/1015] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:36.439618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:36.440624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:36.447249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:36.447682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:36.448485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:36.448914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:36.477938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ec9313af-337e-49aa-ac7e-2097dacf0f40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042321 Dec 17 12:45:36.478493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 506/1016] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:36.867982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:36.868685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:36.876045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:36.876490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:36.877306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:36.877747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:37.017400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:37.026511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:37.028032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:37.029255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1c93b836-a573-4695-a246-5270a2cb3485 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165680 Dec 17 12:45:37.029843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 511/1017] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:37.488669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:37.489652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:37.496306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:37.496778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:37.497643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:37.498076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:37.526996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dd759e00-5bf2-4851-a14a-f3eaa4608936 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 Dec 17 12:45:37.527538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 507/1018] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:38.050970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:38.051976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:38.062694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:38.063437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:38.064722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:38.065476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:38.203731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:38.213237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:38.214767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:38.215888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cf7996eb-0bc1-4934-83d0-36c024ca768e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171298 Dec 17 12:45:38.216410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 512/1019] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:38.538386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:38.539304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:38.546187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:38.546483 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:38.547247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:38.547676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:38.577909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fa44c0b5-dbd7-4e2b-a1ec-c2dce6813be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Dec 17 12:45:38.578515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 508/1020] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:39.242140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:39.243120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:39.251572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:39.252012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:39.252804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:39.253227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:39.379290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:39.387984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:39.389506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:39.390639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-281b5737-ccc4-409f-9084-e3861614bdbe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.154840 Dec 17 12:45:39.391194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 513/1021] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:39.590767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:39.593201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:39.600357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:39.600764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:39.601714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:39.602390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:39.633164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-48b64143-b316-4210-b4d5-b8c1e560988e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Dec 17 12:45:39.633755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 509/1022] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:40.411698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:40.412675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:40.421977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:40.422415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:40.423180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:40.423603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:40.566769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:40.578376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:40.579850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:40.581539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aefa06b6-7633-4d08-82f3-51ba8c3c8ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.175471 Dec 17 12:45:40.582118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 514/1023] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:40 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:40.645853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:40.647076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:40.655459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:40.655905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:40.656684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:40.657109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:40.687068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-02f5f84a-ba56-4d8c-86c1-49ec174d39a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Dec 17 12:45:40.687626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 510/1024] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:41.600396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:41.601019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:41.608162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:41.608536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:41.609324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:41.609756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:41.698263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:41.699209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:41.705661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:41.706110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:41.706892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:41.707321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:41.741248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:41.744090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3c08b5e1-dd2e-4596-8005-97f2509f69c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049553 Dec 17 12:45:41.744657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 511/1025] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:41.749575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:41.751059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:41.752204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f3a94d5b-c925-40e9-825c-cba81952ca6c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155659 Dec 17 12:45:41.752754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 515/1026] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:42.756134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:42.757145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:42.764745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:42.765094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:42.765984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:42.766559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:42.770849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:42.771520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:42.778407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:42.778822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:42.779843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:42.780275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:42.802142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d65586f1-1863-4a0b-a6e4-e585d683dd5c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050170 Dec 17 12:45:42.802898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 512/1027] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:42.921366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:42.930000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:42.931470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:42.932643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5edcb498-3991-4e75-a7db-01131f0c40e4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165902 Dec 17 12:45:42.933205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 516/1028] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:43.815032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:43.815940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:43.821992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:43.822407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:43.823214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:43.823641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:43.854473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-63eade3c-ce8b-48f9-aeb5-13591f5966c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Dec 17 12:45:43.855027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 513/1029] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:43.954179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:43.955238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:43.966513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:43.967293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:43.968080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:43.968517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:44.103673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:44.112002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:44.113506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:44.114611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-58cb79ed-940f-45d6-ae64-90f07bd10e3e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166627 Dec 17 12:45:44.115164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 517/1030] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:44.865746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:44.866736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:44.873203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:44.873672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:44.874437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:44.874844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:44.905216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e5c8b5d0-f49c-4007-adff-272154a2e8fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Dec 17 12:45:44.905807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 514/1031] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:45.135809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:45.136652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:45.147316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:45.148065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:45.149428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:45.150150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:45.282749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:45.291689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:45.293190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:45.294376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b84460ee-78e4-423d-b5da-15756bb861d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164871 Dec 17 12:45:45.294949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 518/1032] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:45 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:45.916014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:45.916952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:45.923352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:45.923799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:45.924571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:45.933078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:45.955024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d739c4f1-90c0-450c-9b28-7611956d8e13 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Dec 17 12:45:45.955576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 515/1033] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:46.312173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:46.312749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:46.319558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:46.320001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:46.320775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:46.321198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:46.461711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:46.470362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:46.471848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:46.472982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-38e1ce8b-706a-41fe-bdae-47f94e09ca05 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164628 Dec 17 12:45:46.473573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 519/1034] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:46 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:46.968337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:46.969382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:46.975756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:46.976236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:46.977016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:46.977488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:47.007043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07e46916-5364-467c-988b-05db85a7f466 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Dec 17 12:45:47.007629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 516/1035] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:47.490968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:47.492468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:47.499657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:47.500108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:47.500875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:47.501458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:47.632967 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:47.642829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:47.644301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:47.645494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e25cb870-f1aa-4966-ab53-a0845c5a3852 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158298 Dec 17 12:45:47.646056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 520/1036] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:48.019450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:48.020417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:48.026955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:48.027405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:48.028213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:48.028642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:48.058693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6ca6846a-aa87-4f32-9ed3-3dce3db445a4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Dec 17 12:45:48.059401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 517/1037] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:48.665049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:48.665761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:48.672860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:48.673315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:48.674073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:48.674532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:48.840515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:48.849413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:48.850895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:48.852050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aeb7e57f-7f3c-423c-94ea-7722099fb118 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.191150 Dec 17 12:45:48.852611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 521/1038] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:49.071409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:49.072333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:49.079174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:49.079617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:49.080397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:49.080802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:49.112346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f211606f-777f-4a16-acc7-5d718ca3760b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Dec 17 12:45:49.112900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 518/1039] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:49.869301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:49.869929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:49.876695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:49.877144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:49.877955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:49.878388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:50.025050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:50.034261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:50.035738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:50.036885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44f35c2a-8652-489d-a4e9-55f97f7031c7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171344 Dec 17 12:45:50.037466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 522/1040] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:50.123937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:50.124845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:50.131444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:50.131844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:50.132689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:50.133055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:50.163794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-02b752f4-2238-44ec-9f6f-390aecb009af tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Dec 17 12:45:50.164348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 519/1041] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:51.061535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:51.062576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:51.073348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:51.074152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:51.075447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:51.076164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:51.175358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:51.176413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:51.189031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:51.189031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:51.189031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:51.189031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:51.217900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1c039393-2f65-4278-a073-7664700982b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Dec 17 12:45:51.218639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 520/1042] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:51.226212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:51.234541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:51.236016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:51.237171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-089bd4bf-0f9c-446b-9360-90bed6a3839a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.182089 Dec 17 12:45:51.237804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 523/1043] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:51 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:52.229203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:52.230165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:52.236879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:52.237338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:52.238131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:52.238557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:52.255132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:52.256535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:52.263166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:52.263613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:52.264447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:52.264881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:52.268586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e2fbc1c9-6c36-44da-bfc3-50c510f848d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Dec 17 12:45:52.269194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 521/1044] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:52.544782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:52.553262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:52.554899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:52.556088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cf33b480-a260-43a2-853b-a4554a013618 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.304689 Dec 17 12:45:52.556653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 524/1045] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:53.280680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:53.281799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:53.288204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:53.288640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:53.289450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:53.289873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:53.319392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5bf22d78-94e3-46e0-9c40-2757a2345594 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Dec 17 12:45:53.319943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 522/1046] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:53.578229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:53.579276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:53.590329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:53.591109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:53.592642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:53.593103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:53.727411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:53.735906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:53.737434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:53.738578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-869af24e-d541-460b-9030-8024bec5e146 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166605 Dec 17 12:45:53.739140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 525/1047] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:53 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:54.330317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:54.331370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:54.347052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:54.347708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:54.348447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:54.348949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:54.378654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d5a9ef9-a714-408a-b3a0-b64b361503bf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052382 Dec 17 12:45:54.379314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 523/1048] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:54.760831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:54.761878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:54.770124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:54.770573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:54.771356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:54.771791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:55.110147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:55.119784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:55.121296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:55.122442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bafab92d-b217-429e-80ed-f51164c27938 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.368024 Dec 17 12:45:55.123005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 526/1049] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:55.390322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:55.391252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:55.397605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:55.398049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:55.398827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:55.399253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:55.428786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2c6affc-497a-45d4-9ecb-122883ac3da6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042287 Dec 17 12:45:55.429378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 524/1050] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:56.142041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:56.142674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:56.150055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:56.150500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:56.151281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:56.151717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:56.281259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:56.289912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:56.291383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:56.292512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-18a3db9d-c305-4d13-a5f1-1b927d0796f4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155091 Dec 17 12:45:56.293033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 527/1051] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:56.440578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:56.441517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:56.448281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:56.448691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:56.449516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:56.449950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:56.480878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5fee77a2-9d9a-4d97-8760-436b3eae055c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Dec 17 12:45:56.481470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 525/1052] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:57.314282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:57.315285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:57.325993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:57.326745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:57.328091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:57.328816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:57.467817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:57.476506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:57.478230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:57.479390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-df3782dd-7a12-470e-8498-923815fe7227 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171499 Dec 17 12:45:57.479929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 528/1053] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:57.491830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:57.492740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:57.499293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:57.499728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:57.500490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:57.500911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:57.529994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dc289e46-3c4b-4591-9ca4-17b3d2b47cc2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Dec 17 12:45:57.530545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 526/1054] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:45:58.500760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:58.501884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:58.512489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:58.513196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:58.514479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:58.514909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:58.541240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:58.542174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:58.557178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:58.557877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:58.558669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:58.559274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:58.589058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f1ff352-f3fd-4289-a570-c52543fe277c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Dec 17 12:45:58.589650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 527/1055] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:58.641066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:58.649957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:58.651598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:58.652826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9f67b877-09eb-42f2-9fac-749103795e45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158418 Dec 17 12:45:58.653481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 529/1056] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:45:59.600112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:59.601057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:59.607673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:59.608123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:59.609032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:59.609504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:59.639424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a020783-2a48-4589-9a88-fce3c87bc04c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Dec 17 12:45:59.639979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 528/1057] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:45:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:45:59.671654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:45:59.672255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:45:59.678555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:59.678994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:59.679757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:45:59.680180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:45:59.820884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:59.829778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:59.831233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:45:59.832376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5398864d-d84c-49ed-b410-a76551d11e83 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164600 Dec 17 12:45:59.832894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 530/1058] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:45:59 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:46:00.650737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:00.651690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:00.658219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:00.658674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:00.659479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:00.659912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:00.693541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8c6e9946-bf7e-411f-bade-7498914b082d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Dec 17 12:46:00.694315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 529/1059] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:00.854062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:00.854998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:00.864998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:00.865749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:00.866896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:00.867617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:01.008382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:01.020140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:01.022506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:01.024247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e886bca9-b4b8-4361-9ec5-8fb5ee1a0c8d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.175741 Dec 17 12:46:01.024965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 531/1060] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:01.706760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:01.707673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:01.714592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:01.714928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:01.715725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:01.716153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:01.745222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c4e80d37-7a7f-44c1-8963-6524c9b925c0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Dec 17 12:46:01.745784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 530/1061] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:02.046445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:02.047225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:02.055327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:02.055881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:02.056837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:02.057412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:02.191954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:02.200673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:02.202247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:02.203404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b0083c81-83ae-4a2b-b9d5-1e79033b3795 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163088 Dec 17 12:46:02.203955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 532/1062] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:02.756908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:02.757904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:02.764089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:02.764552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:02.765426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:02.765861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:02.794577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5e5f8bfd-18ba-461d-a5cd-44b87ff85099 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Dec 17 12:46:02.795173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 531/1063] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:03.225630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:03.226631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:03.237349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:03.238112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:03.239342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:03.240101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:03.384380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:03.398283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:03.400596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:03.402440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-52b6d46d-ccd7-4275-8252-890371a4a434 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.182697 Dec 17 12:46:03.403276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 533/1064] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:03.805751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:03.806716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:03.813456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:03.813897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:03.814673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:03.815096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:03.850153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-35b57628-2655-4fc0-84c7-1ec836f9c334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047987 Dec 17 12:46:03.850684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 532/1065] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:04.424228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:04.425094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:04.435807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:04.436556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:04.437919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:04.438638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:04.579685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:04.588822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:04.590335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:04.591488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-58d2e007-761a-4bc9-9abb-e08e2618a206 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.173892 Dec 17 12:46:04.592047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 534/1066] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:04.861548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:04.862471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:04.868979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:04.869538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:04.870358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:04.870800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:04.900876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-beb6e247-80d7-4e35-8505-a24fa74d479e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Dec 17 12:46:04.901485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 533/1067] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:05.609401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:05.610010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:05.616602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:05.617033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:05.617848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:05.618283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:05.750797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:05.759060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:05.760515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:05.761694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b854f355-0763-4f1a-9b63-398c205e1978 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.156077 Dec 17 12:46:05.762249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 535/1068] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:05 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:05.911484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:05.912562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:05.919061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:05.919512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:05.920336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:05.920772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:05.950105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8828c673-aa88-4b1d-b5fa-b2d29ea0c0c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 Dec 17 12:46:05.950664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 534/1069] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:06.780643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:06.781254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:06.788171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:06.788619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:06.789426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:06.789859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:06.933543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:06.942298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:06.943752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:06.944891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a9bf49e7-20a6-42a7-81cd-296c689c7eff tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168061 Dec 17 12:46:06.945473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 536/1070] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:06.961965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:06.962915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:06.969827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:06.970251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:06.971023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:06.971459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:07.000508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7302b260-5e75-4055-8de1-7907a0d7ec4e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Dec 17 12:46:07.001083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 535/1071] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:07.967142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:07.967960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:07.975878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:07.976394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:07.977338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:07.977868 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:08.011375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:08.012253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:08.020629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:08.021324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:08.022361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:08.022888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:08.054292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1401feae-04f1-4021-af2a-0c07dcf21397 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Dec 17 12:46:08.054903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 536/1072] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:08.111799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:08.120156 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:08.121688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:08.122863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afd1777a-5fe0-4e0e-ab57-a7979cfb7f15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162098 Dec 17 12:46:08.123444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 537/1073] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:09.065791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:09.066710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:09.073181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:09.073677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:09.074517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:09.074958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:09.106515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-84f26c83-686b-4883-b3d1-bcea18f24fd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Dec 17 12:46:09.107099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 537/1074] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:46:09.143190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:09.143816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:09.152357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:09.153054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:09.154023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:09.154677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:09.289244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:09.302306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:09.304615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:09.306387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bba069f3-5050-487a-a80b-c3f274d8d8d5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168485 Dec 17 12:46:09.307026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 538/1075] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:10.117998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:10.118907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:10.125733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:10.126151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:10.126944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:10.127366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:10.158300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d55ebb87-797f-4ac7-8441-62a9146be468 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Dec 17 12:46:10.158855 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 538/1076] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:10.328767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:10.329442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:10.337524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:10.338115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:10.338947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:10.339448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:10.476285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:10.485313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:10.486815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:10.487959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a84206d9-28a8-482b-8f9c-07c31e5108c3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164685 Dec 17 12:46:10.488510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 539/1077] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:11.170086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:11.171050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:11.177485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:11.177926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:11.178685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:11.179109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:11.207718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9a073ad-3cfc-435b-a3d8-7d4927735aff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Dec 17 12:46:11.208261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 539/1078] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:11.510014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:11.510870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:11.521518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:11.522258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:11.523525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:11.524249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:11.661665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:11.674345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:11.676092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:11.677559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c6af2ac3-3170-4b00-b493-9d771e6b84ab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.173839 Dec 17 12:46:11.678190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 540/1079] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:11 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:12.219995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:12.220897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:12.230256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:12.230708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:12.231455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:12.232132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:12.262227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3fcfd061-8a6c-413f-ac9a-35c7ea75ee36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Dec 17 12:46:12.262777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 540/1080] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:12.699904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:12.700864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:12.708603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:12.709048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:12.710209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:12.710640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:12.846114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:12.854829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:12.856311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:12.857542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b3e3838f-4b03-4eb8-b995-681b84584abe tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164031 Dec 17 12:46:12.858102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 541/1081] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:13.273809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:13.274778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:13.281462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:13.281844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:13.282612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:13.283036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:13.312005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a90156e4-cf42-4bf8-a996-530e535bed0f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Dec 17 12:46:13.312556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 541/1082] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:13.877295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:13.878142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:13.886814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:13.887413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:13.888458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:13.889011 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:14.032724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:14.041227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:14.042759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:14.043931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-21dd12b7-f68a-4da2-a2b4-6d63e15be1f5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171745 Dec 17 12:46:14.044477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 542/1083] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:14.323365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:14.324281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:14.331147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:14.331602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:14.332383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:14.332805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:14.362211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b5e18af2-e4cf-40e5-b386-e6f3f5f7b9bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Dec 17 12:46:14.362767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 542/1084] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:15.064756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:15.065419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:15.071925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:15.072374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:15.073149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:15.073615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:15.213714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:15.222071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:15.223533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:15.224669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5fbaf56d-ed61-493d-826a-843f2b646332 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165478 Dec 17 12:46:15.225325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 543/1085] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:15.376869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:15.377840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:15.384946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:15.385428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:15.386216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:15.386652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:15.416999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fe613490-1e25-4dea-b184-4e6dcfded7b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Dec 17 12:46:15.417573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 543/1086] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:16.250561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:16.251206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:16.259268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:16.259913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:16.261130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:16.261752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:16.398359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:16.406935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:16.408427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:16.409619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d82e7b76-ced3-4beb-bc1c-1ec5435b8251 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165054 Dec 17 12:46:16.410175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 544/1087] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:16.428184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:16.429130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:16.435553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:16.435972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:16.436744 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:16.437381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:16.467502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6acd5490-e22e-4b81-9130-4203824c4315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Dec 17 12:46:16.468061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 544/1088] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:17.430465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:17.431311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:17.440518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:17.440973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:17.441780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:17.442213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:17.479242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:17.480187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:17.492907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:17.492907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:17.492907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:17.492907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:17.522331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ee6f8e7d-6435-40c0-b05e-73baf3565b60 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Dec 17 12:46:17.523003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 545/1089] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:17.572760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:17.581861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:17.583340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:17.584490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fac4a6a5-a50b-4f60-b764-621e2d170097 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160381 Dec 17 12:46:17.585421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 545/1090] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:18.534012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:18.534994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:18.541526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:18.541999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:18.542774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:18.543195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:18.572651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ae6ddbd6-e693-47e0-bde7-816efec6bef2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042515 Dec 17 12:46:18.573318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 546/1091] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:18.602062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:18.602692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:18.609417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:18.609957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:18.610728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:18.611155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:18.749350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:18.763584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:18.766048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:18.767194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1dc3ae37-8fab-4b63-8e90-34518a6fa115 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168985 Dec 17 12:46:18.767730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 546/1092] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:18 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:19.585690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:19.586673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:19.593107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:19.593577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:19.594393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:19.594819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:19.624486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25297d27-76aa-4e20-b02d-348baff0c1b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 Dec 17 12:46:19.625053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 547/1093] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:19.789584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:19.790499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:19.801204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:19.802044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:19.803334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:19.804053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:19.938991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:19.947970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:19.949469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:19.950630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ab494633-4684-4b09-83f5-78fdb7b88a23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167381 Dec 17 12:46:19.951226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 547/1094] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:46:20.636191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:20.637140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:20.645828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:20.646368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:20.647151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:20.647587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:20.677994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f3c42faf-6578-43ff-88bc-08943cc49d82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Dec 17 12:46:20.678534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 548/1095] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:20.971746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:20.972498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:20.980776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:20.981329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:20.982330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:20.982870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:21.121044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:21.129512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:21.131015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:21.132179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3f2c83ea-d8b6-4438-ae9c-5291b075a891 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165412 Dec 17 12:46:21.132716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 548/1096] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:21.689682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:21.690595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:21.697931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:21.698381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:21.699155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:21.699584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:21.729961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5d79823a-e722-4585-82a6-95a90dea9c86 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Dec 17 12:46:21.730524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 549/1097] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:22.154079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:22.155050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:22.164128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:22.164594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:22.165440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:22.165888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:22.305106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:22.314147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:22.315617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:22.316768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d8dc4cd-dc00-4532-855f-32f27918ae9b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169067 Dec 17 12:46:22.317311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 549/1098] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:22.743250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:22.744570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:22.752798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:22.753238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:22.754032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:22.754464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:22.783472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f18f3cb0-680a-415c-994b-e95b82d3dd31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Dec 17 12:46:22.784015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 550/1099] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:23.339045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:23.340049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:23.348432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:23.348882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:23.349706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:23.350141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:23.490200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:23.499293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:23.500968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:23.502184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2f45e999-86fa-4a9d-b17c-8ccc1e6efdea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169883 Dec 17 12:46:23.502951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 550/1100] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:23.798155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:23.799095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:23.806078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:23.806518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:23.807269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:23.807851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:23.837599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2179483e-b350-4c4c-a8e4-35da060b870d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Dec 17 12:46:23.838305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 551/1101] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:24.521784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:24.522429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:24.529216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:24.529729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:24.530543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:24.530997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:24.677595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:24.686689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:24.688170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:24.689392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1cd6adc1-a700-4a2a-8765-2a1639617ea2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171789 Dec 17 12:46:24.689957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 551/1102] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:24.849147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:24.850131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:24.856579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:24.857016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:24.857824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:24.858388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:24.887801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-60cbcd23-1bc6-4975-b3de-b0b0319401dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Dec 17 12:46:24.888368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 552/1103] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:25.710593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:25.711419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:25.720227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:25.720664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:25.721468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:25.721892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:25.864327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:25.873132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:25.874646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:25.875865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d8b469e8-c11f-4955-b8a8-33324c26ea9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171271 Dec 17 12:46:25.876586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 552/1104] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:25 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:25.899247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:25.900154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:25.906611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:25.907057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:25.907837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:25.908283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:25.937710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-acc33fae-b102-46dc-bffc-96fcd1154938 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 Dec 17 12:46:25.938306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 553/1105] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:26.896992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:26.897862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:26.907892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:26.908575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:26.909800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:26.910455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:26.949175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:26.950416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:26.957076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:26.957770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:26.958570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:26.959003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:27.001564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d000a664-7aeb-42f3-8b42-7466045fa21f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056126 Dec 17 12:46:27.002141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 554/1106] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:27.042733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:27.051273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:27.052732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:27.053904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-545ca0c5-d7b0-4834-8915-c38dca5559c0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162782 Dec 17 12:46:27.054478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 553/1107] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:28.012973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:28.013953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:28.020494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:28.020796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:28.021635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:28.022189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:28.051335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-500a042d-5e48-4993-8e38-c814b0f955b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Dec 17 12:46:28.051880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 555/1108] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:28.071657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:28.072323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:28.078879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:28.079330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:28.080112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:28.080587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:28.214865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:28.223887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:28.225421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:28.226593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dabeefb9-1f20-4819-9738-e3241bdc0a51 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158713 Dec 17 12:46:28.227187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 554/1109] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:28 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:29.065385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:29.066288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:29.073590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:29.074208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:29.075146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:29.075738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:29.106997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-92a1f228-3a64-4269-8bc4-a1cf3e9af6f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Dec 17 12:46:29.107558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 556/1110] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:29.246947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:29.247544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:29.254053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:29.254504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:29.255282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:29.255714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:29.394681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:29.404189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:29.405745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:29.406904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0117b410-d732-487e-8d03-67cfe13b862c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163781 Dec 17 12:46:29.407471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 555/1111] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:29 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:30.118462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:30.119334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:30.126103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:30.126539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:30.127339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:30.127797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:30.159756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f66ca0bb-ab7f-4c94-a2cc-a4a770199596 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Dec 17 12:46:30.160567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 557/1112] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:30.428134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:30.428772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:30.436571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:30.437090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:30.438033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:30.438532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:30.572812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:30.586081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:30.587657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:30.589552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-255100d8-74a8-477d-b0e4-ecbffa4d79a2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166722 Dec 17 12:46:30.590106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 556/1113] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:30 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:31.171551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:31.172514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:31.179134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:31.179533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:31.180231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:31.180668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:31.209627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4178b439-fa05-463e-b16c-df194b8b01c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Dec 17 12:46:31.210537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 558/1114] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:31.611472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:31.612522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:31.623064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:31.623797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:31.625054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:31.625831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:31.754749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:31.763398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:31.764863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:31.766040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-097abf61-eeac-4fda-a18c-36ee59b25902 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160819 Dec 17 12:46:31.766618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 557/1115] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:31 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:32.221439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:32.222420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:32.229236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:32.229718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:32.230499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:32.230933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:32.262386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d7162883-847f-4a03-850c-edb2327f233e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Dec 17 12:46:32.262992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 559/1116] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:32.787728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:32.788728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:32.799431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:32.800238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:32.801015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:32.801490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:32.931791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:32.940966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:32.942485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:32.943666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6ab35c47-2a62-4583-a903-6a12e980ae76 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.162214 Dec 17 12:46:32.944219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 558/1117] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:32 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:33.274146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:33.275107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:33.281533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:33.281955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:33.282771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:33.283167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:33.312966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-004f5688-1da9-431b-bbc6-65fd430ad4bd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Dec 17 12:46:33.313696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 560/1118] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:33.968829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:33.969865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:33.977489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:33.977937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:33.978774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:33.979204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:34.109868 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:34.119077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:34.120552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:34.121779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e2038410-ba22-4fb4-b102-9ef56e82b381 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159210 Dec 17 12:46:34.122338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 559/1119] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:33 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:34.324877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:34.325817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:34.332437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:34.332891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:34.333711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:34.334181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:34.366436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-593a2fe6-40e7-4d27-b579-d2017be19ef4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Dec 17 12:46:34.366920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 561/1120] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:35.140681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:35.141267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:35.149958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:35.150679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:35.151931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:35.152632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:35.292114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:35.305617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:35.307974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:35.309837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-076746ea-caca-4514-a615-fd17abc8ac8c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.172706 Dec 17 12:46:35.310723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 560/1121] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:35 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:35.378175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:35.379091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:35.385545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:35.385992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:35.386765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:35.387291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:35.422527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-615d1084-737c-4ef1-ba69-bb7db92fcbbf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048246 Dec 17 12:46:35.423088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 562/1122] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:36.333702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:36.334728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:36.345674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:36.346419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:36.347523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:36.347950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:36.434458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:36.435960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:36.442055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:36.442736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:36.443522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:36.443916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:36.474308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32e576b0-953a-45ff-a578-f7e618079494 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Dec 17 12:46:36.478088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 563/1123] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:46:36.482368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:36.490724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:36.492209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:36.493406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68320faa-9443-4c3b-8ab8-87e6da528567 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.166005 Dec 17 12:46:36.493998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 561/1124] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:36 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:37.485588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:37.486539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:37.492887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:37.493348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:37.494152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:37.494593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:37.511303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:37.512142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:37.518881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:37.519417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:37.520272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:37.520779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:37.523780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac47ef60-b49c-4ccd-97c9-516ccceed205 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 Dec 17 12:46:37.524359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 564/1125] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:37.651128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:37.660108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:37.661659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:37.662824 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac267644-002d-49cf-b021-9c2cb6c8c550 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155427 Dec 17 12:46:37.663389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 562/1126] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:37 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:38.535359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:38.536862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:38.543687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:38.544136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:38.545105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:38.545364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:38.574766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66157aa3-a330-47d7-99fd-44b61835e850 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Dec 17 12:46:38.575315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 565/1127] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:38.685041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:38.686043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:38.696723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:38.697629 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:38.698910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:38.699633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:38.853861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:38.862799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:38.864285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:38.865459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c5a37419-0cb2-4712-833c-73948f425071 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.186926 Dec 17 12:46:38.866009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 563/1128] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:38 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:39.586501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:39.587424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:39.593937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:39.594382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:39.595259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:39.595569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:39.626088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b87209d3-a0d9-4d1f-901d-57b2ce2c01bc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Dec 17 12:46:39.626660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 566/1129] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:39.887760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:39.888766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:39.899397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:39.900141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:39.901477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:39.902201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:40.042261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:40.050779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:40.052269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:40.053488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-416edbb7-5e92-416f-a06a-390b92109195 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.172013 Dec 17 12:46:40.054057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 564/1130] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:39 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:40.637837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:40.638803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:40.645439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:40.645891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:40.646833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:40.647273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:40.676802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e21275dd-e41b-4e47-8640-ac1cd0a47dca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Dec 17 12:46:40.677403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 567/1131] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:41.072136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:41.072774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:41.079773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:41.080283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:41.081185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:41.081812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:41.224098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:41.232805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:41.234343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:41.235498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-513f37b2-b57f-4b48-aa23-66169f3c2d1b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167315 Dec 17 12:46:41.236050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 565/1132] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:41.688255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:41.689245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:41.695664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:41.696110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:41.696881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:41.697324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:41.726740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0358bdda-00dc-4349-b203-a08f3e4d09b3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Dec 17 12:46:41.727298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 568/1133] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:42.257113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:42.258197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:42.269241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:42.270101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:42.271365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:42.272086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:42.464125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:42.472647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:42.474165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:42.475335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-82f7bcbc-8e82-4d05-8537-c92dd6a77252 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.224553 Dec 17 12:46:42.475889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 566/1134] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:42 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:42.738645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:42.739545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:42.745868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:42.746321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:42.747096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:42.747550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:42.777304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-64c182db-a4fa-49d3-bbfc-b6e2513bad25 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Dec 17 12:46:42.777883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 569/1135] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:43.492984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:43.493649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:43.500406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:43.500863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:43.501798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:43.502073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:43.636818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:43.649266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:43.651656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:43.652972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d0586e8-d8a9-4d87-b45c-ffa498d290d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163781 Dec 17 12:46:43.653652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 567/1136] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:43 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:43.792382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:43.793897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:43.804752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:43.805552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:43.806870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:43.807558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:43.841217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c42bfa17-3d0b-4be1-8880-4c345e4cec15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055100 Dec 17 12:46:43.841840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 570/1137] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:44.123027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:46:44.123374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:46:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:46:44.674622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:44.675726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:44.683307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:44.683754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:44.684665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:44.685149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:44.824477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:44.833551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:44.835061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:44.836519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-19f10a49-a42b-4a3e-b86f-d407cf651eea tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168214 Dec 17 12:46:44.837111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 568/1138] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:44 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:44.852026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:44.852943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:44.859700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:44.860146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:44.862126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:44.862565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:44.892154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a019a57-3057-4da0-b6d6-17ea09feeaf6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Dec 17 12:46:44.892856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 571/1139] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:45.788730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:46:45.789141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:46:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:46:45.854480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:45.855090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:45.861931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:45.862375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:45.863144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:45.863570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:45.902910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:45.903848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:45.911130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:45.911546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:45.912157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:45.912541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:45.945155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d247697c-a9d9-4cd6-94d2-fcfb03f2c94d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Dec 17 12:46:45.948972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 572/1140] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:46.005444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:46.013634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:46.015100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:46.016249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cce1b092-1b72-43d0-b8a2-2c854c4a6f77 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.165590 Dec 17 12:46:46.016806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 569/1141] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:45 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:46.959011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:46.959928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:46.966991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:46.967453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:46.968233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:46.968656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:47.035669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:47.036278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:47.043459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:47.043880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:47.044676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:47.045108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:47.151292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb36a0f2-f362-4de3-a46e-3670db65d779 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197706 Dec 17 12:46:47.151821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 573/1142] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:47.156188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:47.156660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:47.162407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:47.162841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:47.163596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:47.164012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:47.176176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:47.184484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:47.186040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:47.187234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-06379462-a74f-4f24-ada4-59536f254f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.156500 Dec 17 12:46:47.187777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 570/1143] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:47 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:47.291844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lazy-loading 'services' on Instance uuid 3e1ede74-0deb-4b88-af72-a692da9b71ed {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:46:47.369976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-46f5e821-c41c-4ffa-93ba-8b49f78e8d9a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed/os-volume_attachments/a4044081-efbf-4921-ba73-b4fe7c75dd04" status: 202 len: 0 microversion: 2.1 time: 0.216909 Dec 17 12:46:47.370596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 574/1144] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 12:46:47 2021] DELETE /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed/os-volume_attachments/a4044081-efbf-4921-ba73-b4fe7c75dd04 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:46:48.166983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:48.168455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:48.179163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:48.179874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:48.181169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:48.181953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:48.206187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:48.206880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:48.213513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:48.213955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:48.214731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:48.215157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:48.215387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-36c3b5c7-b1ab-47f5-94fe-9a999c2e3729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054849 Dec 17 12:46:48.215944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 571/1145] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:48.349105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:48.357445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:48.358963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:48.360144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f99bc3b3-1a57-4b42-95cd-99d8d8e5d430 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158602 Dec 17 12:46:48.360701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 575/1146] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:48 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:49.238930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:49.239847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:49.246549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:49.246993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:49.247771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:49.248200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:49.276955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1ee8371a-3115-433f-9b31-c125abf01fdf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052335 Dec 17 12:46:49.277563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 572/1147] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:49.312751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:46:49.312897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:46:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:46:49.464453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:49.465062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:49.471392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:49.471831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:49.472640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:49.473065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:49.602302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:49.610642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:49.612117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:49.613308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2cdeb7cd-54d4-4d85-8dfd-eec1ac2213aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.237788 Dec 17 12:46:49.613872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 576/1148] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:49 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:50.292524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:50.294045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:50.304728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:50.305531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:50.306826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:50.307546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:50.341649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b65c4a75-9915-4033-812c-884831fd2554 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055396 Dec 17 12:46:50.342196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 573/1149] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:50.472466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:46:50.473038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:46:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:46:50.631033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:50.631632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:50.638623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:50.639063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:50.639825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:50.640245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:50.782842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:50.796611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:50.798931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:50.800423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d6bee0ca-fc43-4e10-8a4b-fbd2d626307f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.173200 Dec 17 12:46:50.800996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 577/1150] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:50 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:51.357067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:51.358572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:51.367075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:51.367521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:51.368293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:51.368711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:51.397095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-914d2ea4-4004-4223-a1e1-e594549876c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Dec 17 12:46:51.397681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 574/1151] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:51.820505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:51.821107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:51.828054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:51.828520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:51.829357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:51.829804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:51.959285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:51.971691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:51.973915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:51.975057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4633b4e-4854-47c1-9a5d-7faa1e5648a3 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159092 Dec 17 12:46:51.975610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 578/1152] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:51 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:52.279916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:52.280404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:52.286434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.286869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.287634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.288059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.311764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:46:52.391591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-949c54dd-5257-419d-9fec-21ddd10fadde tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 204 len: 0 microversion: 2.1 time: 0.115084 Dec 17 12:46:52.392322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 575/1153] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:46:52 2021] DELETE /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 17 12:46:52.400333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:52.400944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:52.407377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.407824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.408193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:52.408601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.409028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.409338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:52.415089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.415528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.416295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:52.416718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:52.446135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b0a5c187-2fc0-4e85-aae7-a4b89f858e48 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Dec 17 12:46:52.446725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 576/1154] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:46:52.549750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:52.560503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-472f48ee-37f9-4168-b239-8baa502f47a2 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1514 microversion: 2.1 time: 0.163733 Dec 17 12:46:52.561223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 579/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:52 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:46:52.995255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:52.996208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:53.005987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.006672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.007827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.008529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.145516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:53.154303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:53.155794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:53.156957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3d75cdf7-4284-48e2-9e74-934479092101 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167487 Dec 17 12:46:53.157555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 577/1156] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:52 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:53.457866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:53.458845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:53.465967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.466406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.467173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.467603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.497417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-331913f5-4e69-4ac4-99e0-2f156661fc2d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Dec 17 12:46:53.498239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 580/1157] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:53.577683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:53.578300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:53.585116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.585590 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.586734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.587152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:53.811463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:53.820693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4fb50fd4-2b53-45dd-bc23-baec01cec244 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 200 len: 1514 microversion: 2.1 time: 0.246933 Dec 17 12:46:53.831021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 578/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:53 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:46:53.984418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-9476483c-93c6-40de-b159-e67df78b3ee2 req-dfac7569-78df-4b67-a215-7147a86e34d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba020eb-5d3a-4c81-a3d6-82feee675c3a", "name": "network-vif-deleted", "tag": "c6b6b500-279e-46dd-b498-2586758dd9fb"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:46:53.986225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:46:53.986225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:46:53.994049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9476483c-93c6-40de-b159-e67df78b3ee2 req-dfac7569-78df-4b67-a215-7147a86e34d5 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:53.994491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9476483c-93c6-40de-b159-e67df78b3ee2 req-dfac7569-78df-4b67-a215-7147a86e34d5 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.007052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-9476483c-93c6-40de-b159-e67df78b3ee2 req-dfac7569-78df-4b67-a215-7147a86e34d5 service nova] Creating event network-vif-deleted:c6b6b500-279e-46dd-b498-2586758dd9fb for instance 0ba020eb-5d3a-4c81-a3d6-82feee675c3a on hv-cinder-80152 Dec 17 12:46:54.011738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-9476483c-93c6-40de-b159-e67df78b3ee2 req-dfac7569-78df-4b67-a215-7147a86e34d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089333 Dec 17 12:46:54.012327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 581/1159] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:46:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:54.174664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:54.175263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:54.181881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.182348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.183118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.183541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.312064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:54.320592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:54.322114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:54.323260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-caf9529e-b96b-4cbd-a9c5-75ce185a4cc5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.152390 Dec 17 12:46:54.323817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 579/1160] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:54 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 17 12:46:54.510193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:54.511327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:54.517732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.518254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.519109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.519540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.555374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-46ec0343-3022-41fe-bde1-416c7267fe08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050063 Dec 17 12:46:54.555920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 582/1161] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:54.837971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:54.838620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 0ba020eb-5d3a-4c81-a3d6-82feee675c3a] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:54.845447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.845899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.846681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.847110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.861069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Instance 0ba020eb-5d3a-4c81-a3d6-82feee675c3a could not be found. Dec 17 12:46:54.861681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 404 to user: Instance 0ba020eb-5d3a-4c81-a3d6-82feee675c3a could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:46:54.862488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0901af5f-b866-42bc-b61e-12facf1389ec tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a" status: 404 len: 111 microversion: 2.1 time: 0.028721 Dec 17 12:46:54.862989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 580/1162] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:54 2021] GET /compute/v2.1/servers/0ba020eb-5d3a-4c81-a3d6-82feee675c3a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:46:54.870879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:54.871447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:54.877762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.878201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.879000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:54.879420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:54.903466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:46:54.990785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fed66eed-590b-48a1-99c2-ca0baa32c226 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 204 len: 0 microversion: 2.1 time: 0.123082 Dec 17 12:46:54.991441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 583/1163] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:46:54 2021] DELETE /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:46:54.999749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:55.000356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:55.006474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.006919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.007689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.008121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.143905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:55.152879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-16595a6d-d812-45ec-a882-130813f70c2a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1514 microversion: 2.1 time: 0.156930 Dec 17 12:46:55.154418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 581/1164] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:54 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:46:55.346977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:55.347967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:55.355259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.355701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.356457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.356917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.499455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:55.508796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:55.510388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:55.511513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-08ee0f2f-19fa-42e6-ac7f-d48a33622e5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171539 Dec 17 12:46:55.512105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 584/1165] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:55 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:55.569639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:55.571373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:55.581427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.582066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.583263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:55.583876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:55.613869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59d514b0-1f3f-4f20-99bb-b152b04c7caa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049678 Dec 17 12:46:55.614348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 582/1166] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:56.170745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:56.171357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:56.178238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.180023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.180849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.181303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.318413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:56.325802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2c698f23-424b-4743-a466-7f496a4d30b4 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 200 len: 1514 microversion: 2.1 time: 0.158792 Dec 17 12:46:56.326556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 585/1167] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:56 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:46:56.351598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-3bc6da97-24b7-4fbb-a216-959f0188f46e req-9bc711c6-ddaa-401b-8473-4bb3296401a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267952f7-83a0-44e8-801b-19f3dd7bad48", "name": "network-vif-deleted", "tag": "17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:46:56.353859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:46:56.353859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:46:56.361938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-3bc6da97-24b7-4fbb-a216-959f0188f46e req-9bc711c6-ddaa-401b-8473-4bb3296401a8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.362382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-3bc6da97-24b7-4fbb-a216-959f0188f46e req-9bc711c6-ddaa-401b-8473-4bb3296401a8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.375136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-3bc6da97-24b7-4fbb-a216-959f0188f46e req-9bc711c6-ddaa-401b-8473-4bb3296401a8 service nova] Creating event network-vif-deleted:17b7e7bf-d7f6-4033-b5bf-3d995a4bf79c for instance 267952f7-83a0-44e8-801b-19f3dd7bad48 on hv-cinder-80152 Dec 17 12:46:56.380483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-3bc6da97-24b7-4fbb-a216-959f0188f46e req-9bc711c6-ddaa-401b-8473-4bb3296401a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Dec 17 12:46:56.381033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 583/1168] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:46:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:46:56.536458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:56.537558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:56.549103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.549897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.551146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.551856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.626653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:56.627622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:56.634032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.634399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.635199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:56.635618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:56.665305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3d99a1c9-3279-4e7e-abc8-6b59df2b0c9b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Dec 17 12:46:56.666092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 584/1169] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:46:56.691478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:56.703359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:56.704900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:56.706089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33c90e1c-ff45-49cf-b577-dd6c17f20e4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.175936 Dec 17 12:46:56.706648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 586/1170] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:56 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:57.346277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:57.347292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 267952f7-83a0-44e8-801b-19f3dd7bad48] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:57.354653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.355246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.355864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.356301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.370779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Instance 267952f7-83a0-44e8-801b-19f3dd7bad48 could not be found. Dec 17 12:46:57.371366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 404 to user: Instance 267952f7-83a0-44e8-801b-19f3dd7bad48 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:46:57.372198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1e1cc98e-b7df-436a-b96f-25199856385a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48" status: 404 len: 111 microversion: 2.1 time: 0.032177 Dec 17 12:46:57.372730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 585/1171] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:46:57 2021] GET /compute/v2.1/servers/267952f7-83a0-44e8-801b-19f3dd7bad48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:46:57.680519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:57.681562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:57.688848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.689304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.690078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.690505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.722576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cb8b90f2-e313-44d5-a2d3-45f7d58c6245 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048094 Dec 17 12:46:57.723132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 587/1172] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:57.723859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:57.724459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:57.730787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.731228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.732031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:57.732457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:57.867691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:57.876739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:57.878289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:57.879449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c55f7f6f-a523-4528-ad54-8cb0d08a5645 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.159305 Dec 17 12:46:57.880000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 586/1173] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:57 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:58.738369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:58.739891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:58.750169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:58.750917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:58.752191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:58.752914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:58.782794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1dd0d9e2-68eb-496f-b51f-148ab0746a12 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051044 Dec 17 12:46:58.783344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 588/1174] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:46:58.901555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:58.902376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:58.913051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:58.913847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:58.915116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:58.915822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:59.050117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:59.063017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:59.064493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:46:59.065682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5968aae4-61b3-4279-9391-95655fb9ecef tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.170585 Dec 17 12:46:59.066231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 587/1175] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:46:58 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:46:59.798563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:46:59.800068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:46:59.807994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:59.808424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:59.809201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:46:59.809663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:46:59.839875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5bf9a6e-dbcf-40a4-8b3f-f0c3cd96bffb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047656 Dec 17 12:46:59.840438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 589/1176] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:46:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:00.087993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:00.088989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:00.099363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:00.100134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:00.100922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:00.101381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:00.237317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:00.250527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:00.253015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:00.254965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8ec582fd-788a-4e31-b9ce-09576ee3288b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.173330 Dec 17 12:47:00.255841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 588/1177] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:00 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:00.852326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:00.853297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:00.860064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:00.860538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:00.861311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:00.861766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:00.891326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-303e308e-5fe2-4eb8-b4e5-3c45bb1ff179 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043331 Dec 17 12:47:00.891803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 590/1178] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:01.277492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:01.278512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:01.288561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:01.289440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:01.290628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:01.296541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:01.430896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:01.439235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:01.440720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:01.441894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8fbd470b-b89b-4071-80a8-7c411a5fbae9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.170799 Dec 17 12:47:01.442481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 589/1179] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:01 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:01.902928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:01.903840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:01.910572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:01.910943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:01.911709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:01.912130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:01.941767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ffa5a37-cf98-43d8-afd7-d92cbfee3f8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Dec 17 12:47:01.942491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 591/1180] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:02.460250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:02.460796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:02.467971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:02.468424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:02.469223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:02.469691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:02.795164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:02.804087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:02.805616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:02.806817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7273e4d8-94ea-4dc5-a536-1acd57c2b764 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.350663 Dec 17 12:47:02.807381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 590/1181] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:02 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:02.957464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:02.958945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:02.965955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:02.966404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:02.967187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:02.967618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:03.002676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f04b7cc-7f1d-44e2-8501-1f60d908ff2c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051295 Dec 17 12:47:03.003433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 592/1182] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:03.824603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:03.825185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:03.831895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:03.832337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:03.833106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:03.833561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:03.965229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:03.974767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:03.976290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:03.977571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5414f78f-5ef5-46ff-98d8-e0a1c51615aa tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.156655 Dec 17 12:47:03.978065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 591/1183] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:03 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:04.017585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:04.018818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:04.028402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:04.029047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:04.030221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:04.030868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:04.062222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f80c08cf-c016-42ff-89d5-eda6f0533dd3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050719 Dec 17 12:47:04.062706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 593/1184] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:04.997240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:04.998069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:05.006723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:05.007317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:05.008348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:05.008927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:05.074222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:05.075136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:05.081651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:05.082105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:05.082887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:05.083320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:05.122842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6405d8a-663a-47e0-a751-00f23dd9158b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Dec 17 12:47:05.122842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 594/1185] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:05.142729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:05.153076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:05.154635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:05.155789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d33bb8e-3eb9-4f29-b85e-c9904c781bd6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163574 Dec 17 12:47:05.156346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 592/1186] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:04 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:06.129229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:06.130760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:06.138170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:06.138649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:06.139472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:06.139931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:06.170495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d2f00db-171b-4fcf-9d17-2897f249512b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Dec 17 12:47:06.171215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 595/1187] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:06.173675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:06.174289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:06.180926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:06.181401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:06.182182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:06.182614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:06.312723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:06.323072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:06.324556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:06.325761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0b85707e-e904-4472-ba65-0038d3ca1306 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155781 Dec 17 12:47:06.326323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 593/1188] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:06 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:07.187383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:07.188908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:07.205653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:07.206710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:07.208104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:07.208723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:07.249027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8dd59409-53bd-4c8d-afe6-420cf4909bc8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067947 Dec 17 12:47:07.249622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 596/1189] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:07.347881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:07.348871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:07.359476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:07.360218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:07.361570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:07.362268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:07.498240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:07.506815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:07.508318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:07.509709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-57573e63-f416-4200-a1c9-28dcf73678cf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.168108 Dec 17 12:47:07.510076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 594/1190] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:07 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:08.264668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:08.266181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:08.276966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:08.277768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:08.279041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:08.279790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:08.312380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9b85e742-9fc0-479c-a7f6-532f9a0ca032 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054107 Dec 17 12:47:08.312925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 597/1191] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:08.530978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:08.531980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:08.540754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:08.541206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:08.542021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:08.542572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:08.673246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:08.682254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:08.683748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:08.684876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4be87f9f-c4ee-40ec-a4ca-094611cf663a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160150 Dec 17 12:47:08.685495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 595/1192] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:08 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:09.327969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:09.329471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:09.338357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:09.338814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:09.339592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:09.340023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:09.369260 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6582809f-6bae-41ee-b908-549b0a716a03 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Dec 17 12:47:09.369837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 598/1193] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:09.706506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:09.707497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:09.715360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:09.715832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:09.716603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:09.717041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:09.856318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:09.864778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:09.866310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:09.867477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d66831d-c156-47bd-8329-38e341963eab tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167269 Dec 17 12:47:09.868032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 596/1194] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:09 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:10.384123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:10.385505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:10.396044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:10.396923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:10.397761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:10.398191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:10.427304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-13d9fe19-c90d-42c7-bfc2-e7bc2f86353d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049672 Dec 17 12:47:10.427855 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 599/1195] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:10.889827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:10.891434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:10.900383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:10.900835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:10.901649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:10.902083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:11.032400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:11.041181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:11.042700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:11.043857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d986ee9d-602c-4c98-baca-984fc29b4e82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160990 Dec 17 12:47:11.044387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 597/1196] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:10 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:11.442265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:11.443903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:11.451276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:11.451774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:11.452648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:11.453129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:11.484722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d8c7e0ea-55e3-4624-8216-4ff7961e97d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 Dec 17 12:47:11.485266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 600/1197] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:12.065649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:12.066693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:12.074413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:12.074880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:12.075684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:12.076139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:12.217307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:12.226011 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:12.227541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:12.228629 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d49932f4-8bc6-4501-a15b-a1a71f8ac890 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.169231 Dec 17 12:47:12.229173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 598/1198] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:12 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:12.499635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:12.500976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:12.511359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:12.512118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:12.513935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:12.514666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:12.547130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f6e98f2-df83-44f9-87d2-3771c87f505b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053980 Dec 17 12:47:12.547679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 601/1199] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:13.247093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:13.247745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:13.254181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:13.254635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:13.255422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:13.255859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:13.391787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:13.400918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:13.402437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:13.403582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-021217bf-3de4-4bf5-936d-535ee041a24d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.160176 Dec 17 12:47:13.404170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 599/1200] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:13 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:13.562667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:13.564115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:13.573106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:13.573582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:13.574356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:13.574780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:13.603854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a920d71-1e99-46eb-99fe-025b4eb5e87a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047474 Dec 17 12:47:13.604334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 602/1201] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:14.425676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:14.426693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:14.437468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:14.438236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:14.439493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:14.440218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:14.571045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:14.579695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:14.581320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:14.582490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-12146067-deb6-48d6-8a8b-6f61dcb87387 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.163260 Dec 17 12:47:14.583055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 600/1202] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:14 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:14.614857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:14.615797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:14.622513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:14.622953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:14.623725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:14.624143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:14.653709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5272ad42-eac1-49ec-a493-4e278a46e16e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Dec 17 12:47:14.654252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 603/1203] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:15.605762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:15.606836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:15.617559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:15.618013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:15.618791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:15.619225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:15.665938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:15.666861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:15.673191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:15.673683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:15.674469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:15.674902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:15.705265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da83639f-a737-4ae9-8d83-2da4e0a60c7e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Dec 17 12:47:15.705586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 604/1204] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:15.759055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:15.767428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:15.768913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:15.770109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c128a52a-2321-462c-afbe-b580fd889cc9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.170711 Dec 17 12:47:15.770676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 601/1205] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:15 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:16.720941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:16.722513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:16.731236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:16.731680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:16.732460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:16.732898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:16.762467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e629f119-0219-4e3a-86c5-2c05e026d261 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Dec 17 12:47:16.763005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 605/1206] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:16.787136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:16.787734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:16.794415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:16.794855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:16.795616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:16.796045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:16.927689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:16.936530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:16.938067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:16.939225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-29e82dc2-b904-4cd4-8f1d-4e23df5cd7af tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.155785 Dec 17 12:47:16.939786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 602/1207] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:16 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:17.777989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:17.779184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:17.787950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:17.788549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:17.789627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:17.790201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:17.823290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-93b89e11-5f42-4b03-a4c0-d2ee142c701a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051548 Dec 17 12:47:17.823841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 606/1208] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:17.967788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:17.969359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:17.978817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:17.979263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:17.980304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:17.980771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:18.115652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:18.128217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:18.130605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:18.132340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c535f258-471e-4dc8-a033-6dd57f2ae25f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.171153 Dec 17 12:47:18.133216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 603/1209] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:17 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:18.837194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:18.838563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:18.845473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:18.845913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:18.846688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:18.847107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:18.876368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c7cded2-4b1d-4367-b5f8-53856cd3bd8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Dec 17 12:47:18.876899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 607/1210] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:19.150481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:19.151090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:19.157407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:19.157856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:19.158628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:19.159126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:19.289414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:19.298123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:19.299596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:19.300751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-94fc3e44-49f8-4fd0-82f2-4eda31f2784e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.154115 Dec 17 12:47:19.301299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 604/1211] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:19 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:19.891355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:19.892828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:19.902163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:19.902618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:19.903387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:19.903837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:19.932591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b11dfdc0-9d56-44ea-b5f8-632634310f42 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Dec 17 12:47:19.933123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 608/1212] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:20.322508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:20.323545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:20.331587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:20.332058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:20.332868 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:20.333332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:20.469624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:20.478313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:20.479810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:20.481060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4bdf3905-5c93-4449-ba21-4753dbaface7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.164757 Dec 17 12:47:20.481723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 605/1213] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:20 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:20.948275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:20.949780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:20.957701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:20.958230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:20.959138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:20.959644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:20.991856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8098cb56-2c00-4b0f-8e6c-dbb879586eae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Dec 17 12:47:20.992403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 609/1214] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:21.499335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:21.499938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:21.506613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:21.507054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:21.507829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:21.508259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:21.641823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:21.650936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:21.652416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:21.653609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ad4088a1-3236-4bbd-bcc3-b91e9c93b652 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.158220 Dec 17 12:47:21.654252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 606/1215] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:21 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:22.007535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:22.009015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:22.019560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:22.020308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:22.021659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:22.022371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:22.053757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a060d2d-c54b-44b1-9207-85b4e75c2c94 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052627 Dec 17 12:47:22.054305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 610/1216] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:22.679494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:22.680544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:22.689224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:22.689703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:22.690486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:22.690914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:22.824037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:22.836626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:22.839349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:22.841120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9550fa22-dbc4-40a9-a833-9d80b4e30de4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.167862 Dec 17 12:47:22.841727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 607/1217] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:22 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:23.069241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:23.070785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:23.079251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:23.079670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:23.080478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:23.080905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:23.110700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d7c0994-8bb0-4d22-b83c-a071480072ae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Dec 17 12:47:23.111262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 611/1218] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:23.860009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:23.860839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:23.870795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:23.871483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:23.872668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:23.873341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.026191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:24.039895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:24.042704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:24.044516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d206cad8-5093-4c8e-87f7-9234bb1bff12 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 200 len: 1748 microversion: 2.20 time: 0.189048 Dec 17 12:47:24.045162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 608/1219] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:23 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 1748 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:24.111864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:24.112379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:24.118955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.119408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.120194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.120626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.122035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:24.122981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:24.128953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.129426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.130375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.130805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.159846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a209c3e5-cc05-41bd-abfc-da49032900ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041540 Dec 17 12:47:24.160408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 609/1220] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:47:24.339517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-633ac7ff-9d6a-4cd9-a446-fcd9625aefdf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments/cc3b5509-990e-4de5-bcd2-1ae706765447" status: 202 len: 0 microversion: 2.20 time: 0.231476 Dec 17 12:47:24.340228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 612/1221] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Dec 17 12:47:24 2021] DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments/cc3b5509-990e-4de5-bcd2-1ae706765447 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:47:24.348782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:24.349761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:24.355792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.356246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.357000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.357466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.386560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1d303814-b5ba-4d8c-96ae-5e5c3ae85c72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041484 Dec 17 12:47:24.387061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 610/1222] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Dec 17 12:47:24 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:24.442066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:24.442581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:24.449041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.449527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.450298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.450725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.475920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:47:24.481689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.compute.api [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Working on deleting snapshot e40d6b69-b108-43b1-a53f-5aa32a31ccaf from shelved instance... Dec 17 12:47:24.995436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Doing local delete in cell 70d6da78-ff38-4fe6-9546-7442c31f6ddc(cell1) {{(pid=127716) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 17 12:47:24.996252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:24.996695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:24.997119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.compute.api [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 17 12:47:25.004537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] deallocate_for_instance() {{(pid=127716) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 17 12:47:25.171438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:25.172337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:25.178914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:25.179372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:25.180154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:25.180579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:25.209642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6369eeab-ac0e-4c9c-ac54-063e5adfd4fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Dec 17 12:47:25.210330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 611/1223] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:26.136284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Updating instance_info_cache with network_info: [] {{(pid=127716) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 17 12:47:26.195442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-e0d4aac1-6982-45b5-b397-ae91e3efdf7a req-14ecc5e8-351b-4f2e-b25f-724c652db198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ef64cd-7c51-44b7-917c-14ff209e0f81", "name": "network-vif-deleted", "tag": "2bde72e9-a3e5-4681-8047-cba579d4e1cb"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:26.197129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:47:26.197129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:47:26.204689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e0d4aac1-6982-45b5-b397-ae91e3efdf7a req-14ecc5e8-351b-4f2e-b25f-724c652db198 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:26.205312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e0d4aac1-6982-45b5-b397-ae91e3efdf7a req-14ecc5e8-351b-4f2e-b25f-724c652db198 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:26.217411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.compute.server_external_events [req-e0d4aac1-6982-45b5-b397-ae91e3efdf7a req-14ecc5e8-351b-4f2e-b25f-724c652db198 service nova] Unable to find a host for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81. Dropping event network-vif-deleted {{(pid=127717) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 17 12:47:26.218379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-e0d4aac1-6982-45b5-b397-ae91e3efdf7a req-14ecc5e8-351b-4f2e-b25f-724c652db198 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.089894 Dec 17 12:47:26.221701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 612/1224] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 17 12:47:26.226565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:26.227560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:26.233920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:26.234362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:26.235208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:26.235632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:26.269143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c20395f1-bb21-43dd-9a77-fa99b1d4fac1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Dec 17 12:47:26.270015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 613/1225] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:26.318358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.scheduler.client.report [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Deleted allocations for instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 Dec 17 12:47:26.452588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-95650408-199c-472f-b0a6-d9c761ce624c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 204 len: 0 microversion: 2.20 time: 2.014097 Dec 17 12:47:26.453090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 613/1226] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Dec 17 12:47:24 2021] DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 0 bytes in 2015 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 17 12:47:26.461445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:26.462391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:26.468329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:26.468768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:26.469591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:26.470018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:26.482867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. Dec 17 12:47:26.483442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:47:26.484283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a48278b4-5f2b-4dda-9df3-c1acad67f260 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 404 len: 111 microversion: 2.20 time: 0.026732 Dec 17 12:47:26.484979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 614/1227] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:26 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:47:26.494201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f63c2bcf-a2d7-4905-9a31-635c2e0713fd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '.version_select at 0x7fba114101f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:26.512924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f63c2bcf-a2d7-4905-9a31-635c2e0713fd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275089504" status: 204 len: 0 microversion: 2.20 time: 0.023022 Dec 17 12:47:26.513639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 614/1228] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Dec 17 12:47:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275089504 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 17 12:47:27.280247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:27.281209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:27.288894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:27.289612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:27.290037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'create', calling method: .version_select at 0x7fba11481160>, body: {"keypair": {"name": "tempest-keypair-1233957268"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:27.290573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:27.291161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:27.304491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:47:27.308644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:47:27.322628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1df66443-31e7-4264-b8de-bfa97b068b46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Dec 17 12:47:27.323245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 615/1229] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:27.842047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:47:27.845610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:47:27.858351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2dc1c54-1679-4044-b207-53d2d2630037 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.572511 Dec 17 12:47:27.858939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 615/1230] 10.222.0.45 () {62 vars in 1198 bytes} [Fri Dec 17 12:47:27 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 574 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 17 12:47:28.334690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:28.336216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:28.343184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:28.343643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:28.344440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:28.344859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:28.375581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-97a68f92-522b-4070-a141-f147c8c14eda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Dec 17 12:47:28.376050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 616/1231] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:29.187063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-730446713", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "983c631a-ec8e-4363-87f4-66a72eb9c7a6"}], "security_groups": [{"name": "tempest-securitygroup--319884149"}], "key_name": "tempest-keypair-1233957268", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:29.297486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] validate_networks() for [('983c631a-ec8e-4363-87f4-66a72eb9c7a6', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 12:47:29.387887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:29.388802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:29.395117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:29.395575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:29.396343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:29.396767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:29.427093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9568537f-c135-464a-a77a-01db4b000d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Dec 17 12:47:29.427656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 617/1232] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:29.720980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 12:47:29.721417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 12:47:29.721896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 12:47:29.722296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 12:47:29.722696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 12:47:29.731459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:29.731899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:29.732696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:29.733332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:29.749821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 12:47:29.754075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Getting quotas for user e9e6181feaf94cd588e4bbf25e87683a and project a723dcdaae5c46c5b7e204c1557e581e. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 12:47:29.765950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 12:47:29.768356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 12:47:29.819554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2ad1d919-93e0-403a-8982-da3c83e20a9f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.637245 Dec 17 12:47:29.824044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 616/1233] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Dec 17 12:47:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 17 12:47:29.830548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:29.831256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:29.889810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:29.897819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:29.899314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:29.900593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-483b1d8e-9594-4c5f-90ae-ad6216eda184 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1281 microversion: 2.20 time: 0.074289 Dec 17 12:47:29.901304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 618/1234] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:29 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:30.439837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:30.440860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:30.447014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:30.447465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:30.448302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:30.448737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:30.479377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2d4f76b8-89bd-4f26-b2c6-4a0bb856e983 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Dec 17 12:47:30.479943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 617/1235] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:30.920044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:30.921307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:30.929805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:30.930571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:30.931625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:30.932393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:31.025309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:31.033530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:31.035026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:31.036139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3b15879b-8a58-4be2-9347-a115327d3d90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1339 microversion: 2.20 time: 0.121478 Dec 17 12:47:31.036706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 619/1236] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:30 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:31.491517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:31.492429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:31.503057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:31.503632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:31.504463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:31.505061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:31.539112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2308ec07-4caf-4065-b818-6423613d84dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051816 Dec 17 12:47:31.539679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 618/1237] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:32.053895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:32.054539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:32.061480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:32.062197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:32.063017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:32.063501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:32.287128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-c763b752-5307-450e-bd5d-ff126fb35828 req-691e2335-e0ee-4081-b481-bfe83ddac88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b", "tag": "9eddf42a-bcbd-4825-af1a-32d5485af3b9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:32.292969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:47:32.292969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:47:32.300331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c763b752-5307-450e-bd5d-ff126fb35828 req-691e2335-e0ee-4081-b481-bfe83ddac88c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:32.300775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c763b752-5307-450e-bd5d-ff126fb35828 req-691e2335-e0ee-4081-b481-bfe83ddac88c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:32.305907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:32.315029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:32.316547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:32.322921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1343fec1-c19c-476c-86a0-8d65dcc14dbc tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.273201 Dec 17 12:47:32.323939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 620/1238] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:32 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:32.333727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-c763b752-5307-450e-bd5d-ff126fb35828 req-691e2335-e0ee-4081-b481-bfe83ddac88c service nova] Creating event network-changed:9eddf42a-bcbd-4825-af1a-32d5485af3b9 for instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b on hv-cinder-80152 Dec 17 12:47:32.342581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-c763b752-5307-450e-bd5d-ff126fb35828 req-691e2335-e0ee-4081-b481-bfe83ddac88c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059715 Dec 17 12:47:32.343310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 619/1239] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:47:32.550066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:32.551260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:32.558240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:32.558619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:32.559721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:32.560136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:32.592012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e834a668-e5a2-47e5-b081-82834c7e816d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045930 Dec 17 12:47:32.592585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 621/1240] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:33.347056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:33.348180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:33.358722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:33.359159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:33.359897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:33.360347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:33.513447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:33.521528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:33.523009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:33.524099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-53d0bc62-5d97-4819-ab27-84ffa5e0904e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.184790 Dec 17 12:47:33.524659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 620/1241] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:33 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:33.608422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:33.609797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:33.620477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:33.621237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:33.622564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:33.623916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:33.653518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4ba5e82-ba28-4171-a5af-4e93b9558da5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052325 Dec 17 12:47:33.654091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 622/1242] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:34.545505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:34.546610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:34.557729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:34.558566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:34.559966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:34.560745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:34.665383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:34.666274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:34.672898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:34.673344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:34.674149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:34.675094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:34.694471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:34.702354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:34.703827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:34.704914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c18c59f6-9537-4d10-8ff8-a280601b90db tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.165717 Dec 17 12:47:34.705521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 621/1243] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:34 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:34.706004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-683352d2-f726-47ed-b65e-843d8075ac39 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Dec 17 12:47:34.706784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 623/1244] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:35.718062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:35.718971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:35.722788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:35.723390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:35.725672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:35.726118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:35.726900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:35.727330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:35.729957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:35.730400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:35.731187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:35.731617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:35.757348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f669775-0371-483e-b8f1-8cb94d6f4809 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Dec 17 12:47:35.757924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 622/1245] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:35.870907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:35.879243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:35.880787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:35.882024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8e892dd0-1f4c-471d-bb8d-257d28247540 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.162954 Dec 17 12:47:35.882570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 624/1246] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:35 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:36.768209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:36.769197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:36.775972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:36.776395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:36.777499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:36.778221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:36.811210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-adb16e61-ea07-4d16-839c-80f83d1355f0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Dec 17 12:47:36.811795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 623/1247] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:36.903638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:36.904630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:36.915416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:36.916036 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:36.917324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:36.918049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:37.045140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:37.053811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:37.055285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:37.056399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b0025531-99d8-4294-851f-4edb2c6246f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.159089 Dec 17 12:47:37.056963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 625/1248] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:36 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:37.826037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:37.827491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:37.834372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:37.834814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:37.835581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:37.836006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:37.865400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7979231e-7b66-4d8f-b16d-a069bd6bf6de tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Dec 17 12:47:37.865950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 624/1249] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:38.074196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:38.074904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:38.081932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:38.082318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:38.083103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:38.083539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:38.225974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:38.234058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:38.235545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:38.236653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6e92dab0-08de-4a42-9397-c99074b8ba9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.166463 Dec 17 12:47:38.246910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 626/1250] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:38 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:38.247902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-53a610df-4eba-4292-a696-973774401cd2 req-41666bd6-ec1d-44f3-a65d-152f95487ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b", "name": "network-vif-plugged", "status": "completed", "tag": "9eddf42a-bcbd-4825-af1a-32d5485af3b9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:38.250241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:47:38.250241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:47:38.257010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-53a610df-4eba-4292-a696-973774401cd2 req-41666bd6-ec1d-44f3-a65d-152f95487ee3 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:38.257497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-53a610df-4eba-4292-a696-973774401cd2 req-41666bd6-ec1d-44f3-a65d-152f95487ee3 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:38.271310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-53a610df-4eba-4292-a696-973774401cd2 req-41666bd6-ec1d-44f3-a65d-152f95487ee3 service nova] Creating event network-vif-plugged:9eddf42a-bcbd-4825-af1a-32d5485af3b9 for instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b on hv-cinder-80152 Dec 17 12:47:38.276600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-53a610df-4eba-4292-a696-973774401cd2 req-41666bd6-ec1d-44f3-a65d-152f95487ee3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095734 Dec 17 12:47:38.277216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 625/1251] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:38.877631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:38.878550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:38.885040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:38.885523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:38.886305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:38.886737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:38.915819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a895d0e8-1ad5-474c-88a8-e9f097d7d2ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Dec 17 12:47:38.916384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 627/1252] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:39.255163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:39.256109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:39.263002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:39.263446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:39.264445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:39.264872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:39.399543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:39.411559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:39.413572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:39.415265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1066e9af-7e7c-4190-98e8-6eca51687507 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1406 microversion: 2.20 time: 0.163924 Dec 17 12:47:39.416067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 626/1253] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:39 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:39.928568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:39.929512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:39.935985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:39.936437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:39.937220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:39.937685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:39.967746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1569fcf2-b0ac-4f2a-960c-3dc5dba6e00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Dec 17 12:47:39.968528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 628/1254] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:40.435383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:40.435982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:40.442634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.443072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:40.443832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.444255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:40.578081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:40.586221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:40.588036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:47:40.589175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5ad0566-5926-44de-9eed-a5fa68d0af45 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1598 microversion: 2.20 time: 0.157549 Dec 17 12:47:40.589768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 627/1255] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:47:40 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:40.606151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:40.606640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:40.612391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.612826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:40.613622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.614043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:40.711833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-560955ad-d7a0-479e-9ef7-6347b301c4d1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109031 Dec 17 12:47:40.713007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 629/1256] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Dec 17 12:47:40 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:47:40.980176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:40.981188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:40.987824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.988262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:40.989012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:40.989482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:41.018835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77afb3b9-3726-4113-a7de-9b90f0281b8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Dec 17 12:47:41.019446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 628/1257] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:42.030605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:42.031651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:42.038474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:42.038912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:42.039693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:42.040135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:42.054469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:42.055386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:42.061840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:42.062267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:42.063118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:42.063545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:42.084209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2addba62-d9ed-40ca-86ec-73262145d34c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057346 Dec 17 12:47:42.085056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 630/1258] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:42.089931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-7a0756a4-022c-4b6c-bf32-93aec891a427 req-57de6fb5-d463-4889-8ea4-2cf490b8638d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b", "tag": "9eddf42a-bcbd-4825-af1a-32d5485af3b9"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:42.091326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:47:42.091326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:47:42.098278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7a0756a4-022c-4b6c-bf32-93aec891a427 req-57de6fb5-d463-4889-8ea4-2cf490b8638d service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:42.098716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7a0756a4-022c-4b6c-bf32-93aec891a427 req-57de6fb5-d463-4889-8ea4-2cf490b8638d service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:42.109176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-7a0756a4-022c-4b6c-bf32-93aec891a427 req-57de6fb5-d463-4889-8ea4-2cf490b8638d service nova] Creating event network-changed:9eddf42a-bcbd-4825-af1a-32d5485af3b9 for instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b on hv-cinder-80152 Dec 17 12:47:42.114251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-7a0756a4-022c-4b6c-bf32-93aec891a427 req-57de6fb5-d463-4889-8ea4-2cf490b8638d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027820 Dec 17 12:47:42.115062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 631/1259] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:42.127497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a3252f6-5bfa-4a1d-8d7a-91532946efbd tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.076462 Dec 17 12:47:42.128286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 629/1260] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:42 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:43.097258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:43.098259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:43.104369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:43.104814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:43.105617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:43.106044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:43.136453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-76426b98-e66d-4cbe-9e2c-164dcd5f899d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Dec 17 12:47:43.140110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 632/1261] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:43.141216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:43.141216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:43.148345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:43.148787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:43.149632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:43.150082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:43.211293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f5c3830-44a9-43bc-a8a7-2bfdd3c54132 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.075833 Dec 17 12:47:43.212187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 630/1262] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:43 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:47:44.151770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:44.153266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:44.161412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:44.161863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:44.162635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:44.163059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:44.191883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11b54daf-c02f-44cd-88cd-79f5d2578c57 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Dec 17 12:47:44.192453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 633/1263] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:44.223529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:44.224515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:44.231709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:44.232152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:44.232930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:44.233523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:44.292050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e1d02ec5-5c05-4f38-b53b-e0ba11e9140f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.072413 Dec 17 12:47:44.292690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 631/1264] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:44 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:45.205094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:45.205962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:45.212853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:45.213331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:45.214124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:45.214558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:45.244286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8cde144c-5b77-4653-b496-62df8bf6f4dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Dec 17 12:47:45.244846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 634/1265] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:45.304014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:45.305004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:45.312323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:45.313125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:45.314074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:45.314678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:45.378898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a4b4de0-5700-4357-bac1-11c5d040976e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.078918 Dec 17 12:47:45.379560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 632/1266] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:45 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:46.260212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:46.261615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:46.272409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:46.273150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:46.274499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:46.275219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:46.307046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f8a037d9-a11b-4e49-84ef-d142621b5386 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053409 Dec 17 12:47:46.307599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 635/1267] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:46.394403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:46.396024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:46.407286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:46.407732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:46.408512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:46.408952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:46.471434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-745a47e7-8778-4f66-b25e-6423e761ffcf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.083775 Dec 17 12:47:46.475468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 633/1268] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:46 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:47.322869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:47.324339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:47.334985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:47.335722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:47.337000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:47.338140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:47.369765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1c57bd67-e4cd-428f-8526-65ecbadf4783 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053212 Dec 17 12:47:47.370292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 636/1269] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:47.486713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:47.487825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:47.495720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:47.496221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:47.497089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:47.497611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:47.556943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cc1c45db-e44b-4391-9cea-2c680c13a41c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.076484 Dec 17 12:47:47.557582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 634/1270] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:47 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:48.386025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:48.387458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:48.395640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:48.396094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:48.396880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:48.397319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:48.426671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5a4e7a67-7699-49c5-a3ff-6e72e2e14821 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Dec 17 12:47:48.427221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 637/1271] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:48.573707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:48.575314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:48.586584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:48.587318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:48.588962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:48.589714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:48.648983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e485c117-42df-4b7f-ab52-f2a32783d4df tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.082623 Dec 17 12:47:48.649530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 635/1272] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:48 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:49.443250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:49.444883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:49.452427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:49.452872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:49.453695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:49.454124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:49.492178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-51a1cff7-9631-4bf6-bb7f-9d5720c7a4d9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056319 Dec 17 12:47:49.492737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 638/1273] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:49.665202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:49.666779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:49.675641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:49.676090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:49.676877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:49.677320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:49.741476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-18cca793-b24e-49d3-b297-05adf4396849 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.082910 Dec 17 12:47:49.742019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 636/1274] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:49 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:50.504188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:50.505064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:50.512344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:50.512795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:50.513713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:50.514164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:50.557764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-48ba7418-18c2-4b48-83a7-21527d3c4aa9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057507 Dec 17 12:47:50.558377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 639/1275] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:50.753380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:50.754478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:50.762074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:50.762523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:50.763735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:50.764315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:50.831828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3a652c69-068e-42a5-9458-9e4722f88104 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 14 microversion: 2.20 time: 0.082627 Dec 17 12:47:50.832507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 637/1276] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:50 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:47:51.569476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:51.570391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:51.577052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:51.577526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:51.578298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:51.578732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:51.608729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1e2e8d72-8d1c-4120-85ef-b5b4e1ebfede tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Dec 17 12:47:51.609321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 640/1277] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:51.845096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:51.846222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:51.853629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:51.854178 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:51.855104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:51.855545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:51.936493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca18415f-ed81-448c-841b-29d222c294f1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 3708 microversion: 2.20 time: 0.095204 Dec 17 12:47:51.937319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 638/1278] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:51 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 3708 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:47:52.620580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:52.621533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:52.628486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:52.628940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:52.629753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:52.630193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:52.662466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5904c610-ad81-4cba-8f0d-7f51c692b0c1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Dec 17 12:47:52.663074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 641/1279] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:52.948537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:52.949472 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:52.956656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:52.957107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:52.957926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:52.958373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:53.039487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-760205e9-9374-4672-a628-4b4d8fd6bb35 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 15025 microversion: 2.20 time: 0.095073 Dec 17 12:47:53.040688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 639/1280] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:52 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 15025 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:53.674645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:53.675659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:53.682442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:53.682883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:53.683651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:53.684075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:53.715866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f6c5ea63-edf6-42bc-9cb9-1e7d55065147 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Dec 17 12:47:53.716439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 642/1281] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:54.055459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:54.056960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:54.063762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:54.064199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:54.064979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:54.065432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:54.147486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5f7befb5-71c6-4158-a9dd-9fdda041d665 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 18561 microversion: 2.20 time: 0.098056 Dec 17 12:47:54.148135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 640/1282] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:54 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 18561 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:54.728674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:54.729611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:54.736589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:54.737034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:54.737848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:54.738280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:54.769065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-406b1132-fb0e-492e-a6cf-32205721ba01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Dec 17 12:47:54.769635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 643/1283] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:55.160877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:55.161936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:55.169669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:55.170266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:55.171372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:55.171980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:55.260432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ffc168cf-6e60-4a20-9486-53ef7a4b315e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 19342 microversion: 2.20 time: 0.104551 Dec 17 12:47:55.261066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 641/1284] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:55 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 19342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:55.780741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:55.781691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:55.788715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:55.789162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:55.789995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:55.790428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:55.824978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a9744118-a313-4183-a99d-54ac09eb6ae9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Dec 17 12:47:55.825651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 644/1285] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:56.273014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:56.274071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:56.281561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:56.282002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:56.282775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:56.283307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:56.355125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66bb6061-d2e0-4f99-8b98-12f743212a84 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 22168 microversion: 2.20 time: 0.086226 Dec 17 12:47:56.355779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 642/1286] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:56 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 22168 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:56.836812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:56.837771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:56.844925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:56.845407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:56.846192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:56.846630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:56.876015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eb369d69-a8fe-4ff9-980f-bd7d0dacf13a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Dec 17 12:47:56.876561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 645/1287] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:57.367742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:57.368737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:57.376356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:57.376797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:57.377617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:57.378042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:57.451932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bde44c2a-3628-4dfe-9c61-64b3384cade6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 23770 microversion: 2.20 time: 0.088201 Dec 17 12:47:57.452575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 643/1288] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:57 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 23770 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:57.891645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:57.893174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:57.904447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:57.905223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:57.906581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:57.907302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:57.959299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a1f3de4-6a40-4c80-b1b6-dc946efc044c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073918 Dec 17 12:47:57.960374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 646/1289] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:58.465668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:58.466845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:58.476714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:58.477467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:58.478392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:58.478994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:58.559422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-51277eee-9702-49b1-bcf9-004656c09e73 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 25230 microversion: 2.20 time: 0.098919 Dec 17 12:47:58.560445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 644/1290] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:58 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 25230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:47:58.974194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:47:58.975116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:58.981929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:58.982419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:58.983205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:58.983636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:59.015285 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b0888120-d8ad-45f1-98dd-034988b91803 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Dec 17 12:47:59.015856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 647/1291] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 12:47:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:47:59.574255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:47:59.575244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:47:59.585103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:59.585593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:59.586369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:47:59.586794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:47:59.662572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9f9ae07-95fc-4cde-91a3-2a510af5dc68 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 26773 microversion: 2.20 time: 0.092772 Dec 17 12:47:59.663138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 645/1292] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:47:59 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 26773 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:00.030855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:00.031937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:00.040554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:00.041174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:00.042464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:00.043043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:00.122921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-762c0cf6-4236-4052-b5dd-58092615200c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action" status: 200 len: 97228 microversion: 2.1 time: 0.097138 Dec 17 12:48:00.123593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 648/1293] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 12:48:00 2021] POST /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09/action => generated 97228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:48:00.675547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:00.676560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:00.685777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:00.686227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:00.687136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:00.687576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:00.785094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f2cc007-a56d-4750-9a86-72066b149ffb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 27691 microversion: 2.20 time: 0.113695 Dec 17 12:48:00.785835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 646/1294] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:00 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 27691 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:01.797257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:01.798259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:01.807453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:01.807896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:01.808688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:01.809116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:01.884923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-89620656-ab76-4e1a-8075-39ab08fd30a1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28002 microversion: 2.20 time: 0.091636 Dec 17 12:48:01.885614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 649/1295] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:01 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28002 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:02.897017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:02.898061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:02.905299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:02.905754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:02.906526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:02.906967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:02.980235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ef39d02-7ad7-4d0e-8f84-8c8f07703258 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.087242 Dec 17 12:48:02.981012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 647/1296] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:02 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:03.992849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:03.993890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:04.001102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:04.001596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:04.002396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:04.002825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:04.066597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-50c3e0b8-a5c2-4d78-91c8-7a2f4eef3ea7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.077776 Dec 17 12:48:04.067252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 650/1297] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:03 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:05.080141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:05.081138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:05.088780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:05.089233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:05.090037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:05.090460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:05.153526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff7225ee-a83e-43a0-b8fb-2ee8dc7b2624 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.077380 Dec 17 12:48:05.154161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 648/1298] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:05 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:06.166266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:06.167275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:06.174587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:06.175044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:06.175811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:06.176267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:06.243263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7e621a7e-901f-4901-b830-b136ecd91685 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.081012 Dec 17 12:48:06.243922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 651/1299] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:06 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:07.256121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:07.257246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:07.264624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:07.265068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:07.265871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:07.266303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:07.325573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-57c45621-de30-47b6-9839-d65a263644c2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.073640 Dec 17 12:48:07.326211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 649/1300] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:07 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:08.338763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:08.339806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:08.347185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:08.347634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:08.348426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:08.348855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:08.410357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-71264208-8c8c-46f5-9817-42e6d0b5d61a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.076097 Dec 17 12:48:08.411004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 652/1301] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:08 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:09.423347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:09.424340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:09.431608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:09.432044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:09.432817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:09.433238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:09.494527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f7546a98-f44c-4542-8021-93ee7dd7e5cb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.075136 Dec 17 12:48:09.495195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 650/1302] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:09 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:10.507378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:10.508399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:10.515790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:10.516248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:10.517038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:10.517514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:10.578111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26e328e0-69cc-4aa3-835a-a982bcb67969 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.074735 Dec 17 12:48:10.578756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 653/1303] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:10 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:11.591198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:11.592189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:11.599444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:11.599883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:11.600726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:11.601190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:11.665224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7028e4f3-aa14-4fb5-b980-641545c36673 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.078347 Dec 17 12:48:11.666027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 651/1304] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:11 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:12.678068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:12.679109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:12.686470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:12.686914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:12.687693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:12.688122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:12.749236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-60aac2d6-eabc-48e1-9270-27c432592b71 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.075246 Dec 17 12:48:12.749919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 654/1305] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:12 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:13.761697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:13.762693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:13.769953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:13.770395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:13.771161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:13.771586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:13.844768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1721b854-164a-4dc6-a55f-55fff2f69ae2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28237 microversion: 2.20 time: 0.087227 Dec 17 12:48:13.845685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 652/1306] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:13 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:14.856912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:14.857962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:14.865227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:14.865702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:14.866482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:14.866914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:14.947642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a2f027b9-7ad4-4d97-a681-fa7f453c5d7b tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28362 microversion: 2.20 time: 0.094677 Dec 17 12:48:14.948482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 655/1307] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:14 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28362 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:15.959696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:15.960844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:15.968381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:15.968838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:15.969656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:15.970080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:16.051869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-737f7ff5-e826-4c38-8ff2-235bd8436a3f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28528 microversion: 2.20 time: 0.096170 Dec 17 12:48:16.052527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 653/1308] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:15 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28528 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:17.067831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:17.069021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:17.076825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:17.077205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:17.078011 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:17.078435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:17.154458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9b1e7704-8e82-424c-bd0b-3b388c364f1d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.092456 Dec 17 12:48:17.155122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 656/1309] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:17 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:18.172529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:18.174223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:18.183840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:18.184279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:18.185013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:18.185479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:18.251474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23f86b38-455e-4e60-a0e7-564d70ff568a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.085059 Dec 17 12:48:18.252288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 654/1310] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:18 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:19.268194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:19.269585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:19.279104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:19.279746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:19.280869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:19.281535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:19.353620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d8b561b-8bd2-4fa9-a493-6f9aeac17154 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.090800 Dec 17 12:48:19.354172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 657/1311] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:19 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:20.370297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:20.370297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:20.378094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:20.378534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:20.379350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:20.379772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:20.443401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99da5789-efe7-4ff2-baa1-aea2b6af2ef1 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.080104 Dec 17 12:48:20.444098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 655/1312] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:20 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:21.456978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:21.457913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:21.465509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:21.465950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:21.466746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:21.467174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:21.559723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7868c08a-45a1-4f3d-a6ca-7b7cac792d72 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.107441 Dec 17 12:48:21.560391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 658/1313] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:21 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:22.573382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:22.574489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:22.581883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:22.582326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:22.583118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:22.583546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:22.649670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-29ff54f6-fa7d-47ff-a024-ed896bf54b6e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.080679 Dec 17 12:48:22.650471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 656/1314] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:22 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:23.662170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:23.663175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:23.671662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:23.671662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:23.673683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:23.673683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:23.738735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-99ebec9d-1e16-4530-a369-3a5e75a00e79 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.080466 Dec 17 12:48:23.739472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 659/1315] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:23 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:24.751319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:24.752358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:24.759129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:24.759583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:24.760344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:24.760767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:24.824288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e5fab6be-14f6-4d7c-9826-62123cc92eaf tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.076956 Dec 17 12:48:24.824954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 657/1316] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:24 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:25.840695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:25.842642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:25.852674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:25.853428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:25.854665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:25.855329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:25.999792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eeca78b8-9840-4090-9974-f60bed7a0e90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.165199 Dec 17 12:48:26.000371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 660/1317] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:25 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:27.014995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:27.016408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:27.025432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:27.025896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:27.026705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:27.027155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:27.090961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d880ae7c-aadb-4ce0-bc22-5233ccc8ff90 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.081340 Dec 17 12:48:27.091503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 658/1318] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:27 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:28.108641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:28.110525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:28.117796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:28.118249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:28.119035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:28.119469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:28.180714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7427fde-cef5-4d29-882b-58a9ab02c3f0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.079151 Dec 17 12:48:28.181203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 661/1319] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:28 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:29.193100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:29.194035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:29.201176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:29.201669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:29.202412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:29.202839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:29.266431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-be81107d-6c04-4a7b-9fd6-ae6dbaf0c6e9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.077462 Dec 17 12:48:29.267076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 659/1320] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:29 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:30.284288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:30.285944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:30.294891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:30.295518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:30.296331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:30.296791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:30.359400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-55a4d88f-3fc9-4b6c-ab00-44b5b530c232 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.082038 Dec 17 12:48:30.360046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 662/1321] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:30 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:31.374052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:31.375216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:31.382773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:31.383218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:31.383999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:31.384426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:31.451876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9961202f-b2c1-49ef-8d3e-61bd8da919c5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.083291 Dec 17 12:48:31.452556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 660/1322] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:31 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:32.466973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:32.467922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:32.475525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:32.476087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:32.477237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:32.477711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:32.559557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-456dc72f-edf2-4299-bfcf-fc2bd1852f0a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.098243 Dec 17 12:48:32.560954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 663/1323] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:32 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:33.575352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:33.576361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:33.584314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:33.584748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:33.585596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:33.586015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:33.650809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c449c086-c4db-4a3a-b125-f2bfd85a964d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.080559 Dec 17 12:48:33.651482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 661/1324] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:33 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:34.664678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:34.665717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:34.673583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:34.674001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:34.675040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:34.675232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:34.748111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-19121908-5dac-457a-a194-1e70070d27e5 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.087943 Dec 17 12:48:34.748785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 664/1325] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:34 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:48:35.761223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:35.762152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:35.769534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:35.770041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:35.772050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:35.772050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:35.836766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d4ea7c8-acb0-454b-b4b8-b11469d8539d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.079748 Dec 17 12:48:35.837487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 662/1326] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:35 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:36.848876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:36.854216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:36.858792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:36.859377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:36.860455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:36.860881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:36.930215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6905345a-96e5-49fb-b261-ac9e0aa3cb4d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.085308 Dec 17 12:48:36.930891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 665/1327] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:36 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:48:37.946042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:37.947079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:37.954500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:37.954946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:37.955728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:37.956158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:38.019725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aacebeb8-2140-4d9a-9054-4a879c41084d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.077957 Dec 17 12:48:38.020390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 663/1328] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:37 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:39.032850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:39.033872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:39.041260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:39.041764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:39.042551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:39.043176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:39.121051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1054d7ba-b4f2-47fd-aac7-67546c0093d4 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.090607 Dec 17 12:48:39.121051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 666/1329] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:39 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:40.132642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:40.133579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:40.141415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:40.141855 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:40.142649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:40.143071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:40.205455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc4620c3-b099-4b81-9def-06a37ecaa2d0 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.076864 Dec 17 12:48:40.206137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 664/1330] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:40 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:41.219989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:41.220906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:41.229915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:41.230396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:41.231152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:41.231601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:41.300945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-077f5896-7c78-4e12-a1a7-d4cd36278df7 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.086264 Dec 17 12:48:41.301769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 667/1331] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:41 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:42.314661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:42.315671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:42.322863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:42.323310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:42.324087 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:42.324521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:42.392866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-125ed6a3-4a9e-44ca-b5de-2e69f55931da tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.082272 Dec 17 12:48:42.393566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 665/1332] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:42 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:43.409315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:43.410316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:43.417598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:43.418040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:43.418826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:43.419282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:43.486545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1d7a3c20-613a-4e88-b06d-ed9344bfc09d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.083213 Dec 17 12:48:43.487216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 668/1333] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:43 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:44.501349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:44.502513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:44.510579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:44.511035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:44.511911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:44.512356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:44.582491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b834d277-b443-42cc-a5a8-bd353d8f0c39 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.085869 Dec 17 12:48:44.583229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 666/1334] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:44 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:45.596765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:45.598954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:45.607954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:45.608392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:45.609176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:45.609638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:45.675622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c849a289-5229-477d-9717-a321293503e2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.083309 Dec 17 12:48:45.676406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 669/1335] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:45 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:46.688332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:46.689405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:46.697305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:46.697867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:46.698651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:46.699126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:46.767147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33bf26c4-d4dc-41a1-bbb5-b0522e610813 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 28696 microversion: 2.20 time: 0.082574 Dec 17 12:48:46.768035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 667/1336] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:46 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 28696 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:48:47.784587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:47.785691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:47.792936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:47.793419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:47.794218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:47.794656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:47.874830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6679577f-092a-466f-89b1-af377dbe38d6 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 30258 microversion: 2.20 time: 0.098005 Dec 17 12:48:47.875502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 670/1337] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:47 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 30258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:48:48.890093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:48.891375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:48.900786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:48.901423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:48.902382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:48.903016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:48.987665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28296db5-abb6-49bf-bbd3-b26187e45f6a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 32377 microversion: 2.20 time: 0.103162 Dec 17 12:48:48.988504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 668/1338] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:48 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 32377 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 17 12:48:50.002080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:50.003105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:50.010427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:50.010898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:50.011686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:50.012100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:50.095545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-21961cea-421c-40bc-8d25-ae2aeef62f9d tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 33642 microversion: 2.20 time: 0.098550 Dec 17 12:48:50.096099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 671/1339] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:49 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 33642 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:51.108586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:51.109562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:51.116635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:51.117074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:51.117878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:51.118299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:51.197013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-463a842f-299f-4ddc-ab06-de5c8c4f775c tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 34880 microversion: 2.20 time: 0.092566 Dec 17 12:48:51.198730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 669/1340] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:51 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 34880 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:52.210549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:52.211461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:52.219130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:52.219600 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:52.220366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:52.220795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:52.298204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9692f9ee-520c-48ad-968d-8ccb8c3c1a82 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 36011 microversion: 2.20 time: 0.091847 Dec 17 12:48:52.298844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 672/1341] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:52 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 36011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:53.312214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:53.313246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:53.320239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:53.320679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:53.321495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:53.321909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:53.411896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5e94e193-6d6a-4d71-b5fa-6e4692890da2 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 37773 microversion: 2.20 time: 0.103896 Dec 17 12:48:53.412569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 670/1342] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:53 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 37773 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:54.425093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:54.426422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:54.433977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:54.434514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:54.435379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:54.435897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:54.521849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5f7b53e0-0894-4f69-af23-9a6a26b507de tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 38250 microversion: 2.20 time: 0.100994 Dec 17 12:48:54.522544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 673/1343] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:54 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 38250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:55.534775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:55.535781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:55.542965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:55.543412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:55.544200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:55.544634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:55.607254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-65047d42-9b3c-4242-ad76-b6029ffe6c11 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 38250 microversion: 2.20 time: 0.076546 Dec 17 12:48:55.607919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 671/1344] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:55 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 38250 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:56.620088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:56.621113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:56.628252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:56.628698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:56.629515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:56.629948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:56.697450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9cee0aeb-e649-4769-842d-cea658161855 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 38250 microversion: 2.20 time: 0.081167 Dec 17 12:48:56.699325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 674/1345] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:56 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 38250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:57.712633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:57.713664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:57.721059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:57.721533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:57.722303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:57.722726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:57.784461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6445616e-46da-46d5-8179-3a66359118ae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 38250 microversion: 2.20 time: 0.075892 Dec 17 12:48:57.785133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 672/1346] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:57 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 38250 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:58.799964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:48:58.800972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:58.808628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:58.809073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:58.809934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:58.810367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:58.886995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ddb81763-0695-4788-8d35-99071138c295 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action" status: 200 len: 38391 microversion: 2.20 time: 0.091720 Dec 17 12:48:58.887678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 675/1347] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Dec 17 12:48:58 2021] POST /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/action => generated 38391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:48:58.905331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:48:58.905962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:48:58.918923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:58.919374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:58.920166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:48:58.920597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:48:58.951440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-43b8693e-1d07-4836-8793-cdf3a67eff15 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/ips" status: 200 len: 151 microversion: 2.20 time: 0.056892 Dec 17 12:48:58.952048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 673/1348] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Dec 17 12:48:58 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 12:50:04.150306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:50:04.151064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:50:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:50:05.815762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:50:05.816346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:50:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:50:09.330016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:50:09.330791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:50:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:50:10.501034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:50:10.501890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:50:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:51:58.844744 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:51:58.845382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:51:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:52:12.833245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:52:12.833772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:52:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:52:47.143800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 17 12:52:47.148182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:47.148779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:47.155465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:47.155947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:47.156737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:47.157173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:47.185784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:52:47.263603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-201aab02-cfbe-4359-8b2d-2c07b58eafdd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 204 len: 0 microversion: 2.1 time: 0.121508 Dec 17 12:52:47.264193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 676/1349] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:52:47 2021] DELETE /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:52:47.272661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5febd58d-ad76-4cf9-a5df-876efa8b0365] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 17 12:52:47.286160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:47.286791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:47.292971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:47.293456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:47.294220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:47.294673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:47.584804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:47.595492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-671b603c-ac0c-469a-8487-17be87944c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.326293 Dec 17 12:52:47.596269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 674/1350] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:48.613766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:48.614509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:48.637550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:48.637994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:48.638788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:48.639250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:48.660428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60796. Dec 17 12:52:49.076990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:49.085355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8781d103-5b97-4fb5-ac96-4335cb4da1b4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.475818 Dec 17 12:52:49.086130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 677/1351] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:50.104637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:50.105392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:50.124849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.125387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.126631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.127254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.147024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] [5febd58d-ad76-4cf9-a5df-876efa8b0365] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60810. Dec 17 12:52:50.267513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:50.276148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d8c932b-5adc-462a-b457-57e362eef99f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.176543 Dec 17 12:52:50.276731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 675/1352] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:50 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:50.339304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:50.339840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:50.347757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.348266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.349118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.349654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.374768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:52:50.457625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-87c3704e-7c46-4a29-99e2-a009b32590fe tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 204 len: 0 microversion: 2.1 time: 0.121699 Dec 17 12:52:50.458212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 678/1353] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:52:50 2021] DELETE /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:52:50.469564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:50.470427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:50.478045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.478475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.479240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:50.479660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:50.623301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:50.631227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6caa77c-1325-4a40-8676-3e5f55b2f925 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1555 microversion: 2.1 time: 0.167818 Dec 17 12:52:50.631790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 676/1354] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:50 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:51.302826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:51.304070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:51.314869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:51.315503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:51.317042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:51.317958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:51.540137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:51.548617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b09e1a13-9e87-481c-bc70-262c9101cad1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.252845 Dec 17 12:52:51.549224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 679/1355] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:51.649089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:51.649798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:51.657645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:51.658072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:51.658853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:51.659393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:51.794460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242130414eea4adf864436aea5163cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3ff81cb1bd407ea1a6e88feb49a428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:51.802223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-79fc8516-12af-465b-b8ca-90b86919a42a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 200 len: 1555 microversion: 2.1 time: 0.157705 Dec 17 12:52:51.803068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 677/1356] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:51 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:51.945538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-00ff9639-7913-4171-8b27-5e74e3b5f300 req-af64deef-89cc-4983-b10a-49846ad80e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd77a23-be90-4a51-8468-aa7608792be8", "name": "network-vif-deleted", "tag": "f50ba2fb-dc38-4efa-9e99-b4670dcec0c5"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:52:51.947166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:52:51.947166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 12:52:51.953931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-00ff9639-7913-4171-8b27-5e74e3b5f300 req-af64deef-89cc-4983-b10a-49846ad80e00 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:51.954361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-00ff9639-7913-4171-8b27-5e74e3b5f300 req-af64deef-89cc-4983-b10a-49846ad80e00 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:51.968175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-00ff9639-7913-4171-8b27-5e74e3b5f300 req-af64deef-89cc-4983-b10a-49846ad80e00 service nova] Creating event network-vif-deleted:f50ba2fb-dc38-4efa-9e99-b4670dcec0c5 for instance 7bd77a23-be90-4a51-8468-aa7608792be8 on hv-cinder-80152 Dec 17 12:52:51.973380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-00ff9639-7913-4171-8b27-5e74e3b5f300 req-af64deef-89cc-4983-b10a-49846ad80e00 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083657 Dec 17 12:52:51.974194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 680/1357] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:52:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:52:52.566611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:52.567373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:52.574790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:52.575230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:52.576022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:52.576441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:52.722164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:52.730807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fa4377b6-f88a-4378-88fc-e605231053d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168681 Dec 17 12:52:52.731393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 678/1358] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:52 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:52.820238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:52.821123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] [instance: 7bd77a23-be90-4a51-8468-aa7608792be8] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:52.828702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:52.829150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:52.829995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:52.830432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:52.844946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] HTTP exception thrown: Instance 7bd77a23-be90-4a51-8468-aa7608792be8 could not be found. Dec 17 12:52:52.845579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Returning 404 to user: Instance 7bd77a23-be90-4a51-8468-aa7608792be8 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:52:52.846399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a7995c32-8096-4102-8fe3-82313e63013a tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8" status: 404 len: 111 microversion: 2.1 time: 0.031006 Dec 17 12:52:52.846952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 681/1359] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:52 2021] GET /compute/v2.1/servers/7bd77a23-be90-4a51-8468-aa7608792be8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:52:52.855463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d54fe8bf-1d52-4002-a360-259aa1d038e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] Calling method '.version_select at 0x7fba11f30c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:52.877853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d54fe8bf-1d52-4002-a360-259aa1d038e5 tempest-TestMinimumBasicScenario-2065030456 tempest-TestMinimumBasicScenario-2065030456-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2045204590" status: 202 len: 0 microversion: 2.1 time: 0.025979 Dec 17 12:52:52.878422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 679/1360] 10.222.0.45 () {58 vars in 1271 bytes} [Fri Dec 17 12:52:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2045204590 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 12:52:53.747141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:53.747758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:53.754607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:53.755334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:53.756450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:53.757117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:53.904917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:53.913328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-02d650c9-3378-4912-9776-fb387744ef9e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169856 Dec 17 12:52:53.913914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 682/1361] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:53 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:54.935116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:54.935847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:54.943083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:54.943712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:54.944633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:54.945166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:55.398000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:55.407086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-81e980a0-13e0-48f9-a598-fd25faf09a72 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.479496 Dec 17 12:52:55.407767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 680/1362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:56.426809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:56.427415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:56.435515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:56.435961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:56.436887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:56.437350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:56.699874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:56.711812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a9030884-5187-456a-8516-162cb79a224e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.288635 Dec 17 12:52:56.726671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 683/1363] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:56 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:57.728858 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:57.729557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:57.732676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:57.733313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:57.737616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.737616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.738383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.738807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.740239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.740929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.741906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.742516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.765961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:52:57.865993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99425706-f01f-4a7a-b141-484dbcfbd5c6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 204 len: 0 microversion: 2.1 time: 0.140696 Dec 17 12:52:57.866597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 681/1364] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 12:52:57 2021] DELETE /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 12:52:57.876405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:57.877658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:57.884409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.884946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.885873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:57.886495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:57.973180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:57.981895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f3818bb-6610-49af-83fc-bd3bacbb6df1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.253268 Dec 17 12:52:57.982608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 684/1365] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:57 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:58.041461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:58.049504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0158c40e-004b-41fd-9d9a-0a6da32f38af tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1512 microversion: 2.1 time: 0.177565 Dec 17 12:52:58.050354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 682/1366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:57 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:58.999294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:58.999882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:59.006913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:59.007355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:59.008162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:59.008756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:59.075759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:52:59.076394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:52:59.083588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:59.084103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:59.084932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:59.085414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:59.231489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:59.239659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c349779f-f6c6-4b9b-9c22-5787eaa3e98a tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1512 microversion: 2.1 time: 0.168636 Dec 17 12:52:59.240953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 683/1367] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:59 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:59.553963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:52:59.561963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e8076d17-1489-412a-911c-189866eb4ce0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.566575 Dec 17 12:52:59.562553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 685/1368] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:52:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:52:59.911102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-b041b60d-fc21-4b98-8bb5-28dbc9a19448 req-651b3bfc-69c8-4f65-830a-17750e76aa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c28864-8d42-45d6-90c4-e7cb6c3e3c24", "name": "network-vif-deleted", "tag": "37a0972d-1242-406b-b7c5-f0f02924f739"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:52:59.913236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:52:59.913236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:52:59.924881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b041b60d-fc21-4b98-8bb5-28dbc9a19448 req-651b3bfc-69c8-4f65-830a-17750e76aa62 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:52:59.926345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-b041b60d-fc21-4b98-8bb5-28dbc9a19448 req-651b3bfc-69c8-4f65-830a-17750e76aa62 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:52:59.939857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-b041b60d-fc21-4b98-8bb5-28dbc9a19448 req-651b3bfc-69c8-4f65-830a-17750e76aa62 service nova] Creating event network-vif-deleted:37a0972d-1242-406b-b7c5-f0f02924f739 for instance 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 on hv-cinder-80152 Dec 17 12:52:59.947424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-b041b60d-fc21-4b98-8bb5-28dbc9a19448 req-651b3bfc-69c8-4f65-830a-17750e76aa62 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 Dec 17 12:52:59.948517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 684/1369] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:52:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:00.259314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:00.260121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:00.267077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:00.267528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:00.268354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:00.268783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:00.303705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:00.304119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:00.304755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lazy-loading 'fault' on Instance uuid 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 12:53:00.353073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f9bd776357421f97fb8530da002ef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d752190b174dc08eb973b3c2c800ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:00.361593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-adfd2c06-3287-432c-9e73-a8165db7d6f6 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 200 len: 1306 microversion: 2.1 time: 0.107696 Dec 17 12:53:00.362582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 686/1370] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:00 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:00.580015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:00.580843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:00.587379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:00.587822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:00.588601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:00.589026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:00.838104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:00.847187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0d88f420-47f4-4c82-917a-0eb4c1143d93 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.271396 Dec 17 12:53:00.848651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 685/1371] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:00 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:01.379554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:01.381088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] [instance: 06c28864-8d42-45d6-90c4-e7cb6c3e3c24] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:01.388162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:01.388879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:01.389918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:01.390838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:01.408635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] HTTP exception thrown: Instance 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 could not be found. Dec 17 12:53:01.409249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] Returning 404 to user: Instance 06c28864-8d42-45d6-90c4-e7cb6c3e3c24 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:53:01.410141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a1810b77-96d8-4f87-b9b4-21fa92fdba39 tempest-AttachVolumeNegativeTest-1319660843 tempest-AttachVolumeNegativeTest-1319660843-project] 10.222.0.45 "GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24" status: 404 len: 111 microversion: 2.1 time: 0.034825 Dec 17 12:53:01.413335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 687/1372] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:01 2021] GET /compute/v2.1/servers/06c28864-8d42-45d6-90c4-e7cb6c3e3c24 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 12:53:01.871768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:01.872577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:01.880942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:01.881414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:01.882210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:01.882637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:02.309505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:02.318268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3ece2652-7c96-4ebf-ac0f-7559a60238b1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.457017 Dec 17 12:53:02.330331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 686/1373] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:01 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:03.335198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:03.335845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:03.342940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:03.343763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:03.344596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:03.345054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:03.486161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:03.497342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ab3f187a-3f57-4f75-831b-6341fda07ebd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164920 Dec 17 12:53:03.498151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 688/1374] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:03 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:03.556419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c97694a-d075-4ab6-bc9f-ee2f6f6e791a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Action: 'create', calling method: .version_select at 0x7fba11634d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-749285308"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:53:03.853163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c97694a-d075-4ab6-bc9f-ee2f6f6e791a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.423376 Dec 17 12:53:03.853888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 687/1375] 10.222.0.45 () {60 vars in 1154 bytes} [Fri Dec 17 12:53:03 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 17 12:53:03.866396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a2b9485a-bea8-4f93-8163-dcc8d4e2ccac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f93a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:03.914171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a2b9485a-bea8-4f93-8163-dcc8d4e2ccac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052415 Dec 17 12:53:03.914744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 689/1376] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:04.521643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:04.522273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:04.529447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:04.529897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:04.530673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:04.531101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:04.666427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:04.674928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eef1f66e-65df-4177-829b-589606e53176 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160028 Dec 17 12:53:04.675516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 688/1377] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:04.927727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-665644f2-fc34-40a8-a530-85f031e11bdb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:04.978086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-665644f2-fc34-40a8-a530-85f031e11bdb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054657 Dec 17 12:53:04.978660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 690/1378] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:05.692544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:05.693302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:05.700112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:05.700553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:05.701369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:05.701804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:05.843609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:05.855773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77e017c5-6ad2-4f31-b49b-963b8b03b42b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166764 Dec 17 12:53:05.856799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 689/1379] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:05 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:05.991750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2358b772-1e25-4f2a-89dc-ac44a7f4e22f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e40940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:06.039279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2358b772-1e25-4f2a-89dc-ac44a7f4e22f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051968 Dec 17 12:53:06.039864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 691/1380] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:06.876058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:06.876670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:06.883388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:06.883823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:06.884597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:06.885024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:07.032347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:07.041009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a44b79cf-4580-4fd5-bc4c-e08c9746512f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168633 Dec 17 12:53:07.041651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 690/1381] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:06 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:07.052081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f869e53-adb2-4576-b6a8-58102e3b04d5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:07.100986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f869e53-adb2-4576-b6a8-58102e3b04d5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052819 Dec 17 12:53:07.101554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 692/1382] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:08.066568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:08.067641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:08.078477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:08.079168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:08.080480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:08.081248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:08.113307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ff468067-5d2f-46a9-ad5d-18d118cf2089 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbf040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:08.168450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ff468067-5d2f-46a9-ad5d-18d118cf2089 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058311 Dec 17 12:53:08.169673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 693/1383] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:08.226846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:08.235332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-95a56618-dbb9-4c0d-a04e-273c41166a55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175456 Dec 17 12:53:08.235961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 691/1384] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:08 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:09.183042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-212fed21-95b2-4b7b-b42f-7399f258c9fe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113399d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:09.230299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-212fed21-95b2-4b7b-b42f-7399f258c9fe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052481 Dec 17 12:53:09.230867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 694/1385] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:09.251915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:09.252558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:09.259332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:09.259864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:09.260754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:09.261161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:09.390250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:09.398577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3e35681a-54e2-48d3-a524-b5be4d5a4eac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.150369 Dec 17 12:53:09.399159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 692/1386] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:09 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:10.249951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d7923713-7c88-4e7c-8d5b-0209c27b5e88 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:10.298388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d7923713-7c88-4e7c-8d5b-0209c27b5e88 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055456 Dec 17 12:53:10.298947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 695/1387] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:10.422818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:10.423497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:10.434073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:10.434679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:10.435842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:10.436423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:10.582397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:10.591107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e671832d-d97c-44e0-81e4-973db0d52f0f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174413 Dec 17 12:53:10.591684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 693/1388] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:10 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:11.314960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-be08b972-44f0-4e72-b419-10adf92f3af1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11208160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:11.373092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-be08b972-44f0-4e72-b419-10adf92f3af1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064280 Dec 17 12:53:11.374138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 696/1389] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:11.612420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:11.613479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:11.621704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:11.622147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:11.622922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:11.623356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:11.769532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:11.778177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-27bc2ca9-17f2-4bc0-83f0-fcc6a5897efd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172237 Dec 17 12:53:11.778811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 694/1390] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:12.389877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c63648a-1c32-4ce7-8269-ea58062474bf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d84a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:12.439370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c63648a-1c32-4ce7-8269-ea58062474bf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056319 Dec 17 12:53:12.439922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 697/1391] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:12.795275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:12.795862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:12.802656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:12.803093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:12.803865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:12.804285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:12.949270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:12.957207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-37d66609-059c-47a6-a677-c5aec1c4e1b3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165644 Dec 17 12:53:12.957823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 695/1392] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:12 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:13.455981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-be170a1a-516f-4353-a762-a2f4760781ae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112215e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:13.508544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-be170a1a-516f-4353-a762-a2f4760781ae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059564 Dec 17 12:53:13.509099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 698/1393] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:13.978571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:13.979604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:13.990389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:13.991137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:13.992506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:13.992938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:14.142548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:14.150814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b51a1829-ae07-4150-9537-ec1a3062fe7b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178599 Dec 17 12:53:14.151391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 696/1394] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:14.524672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-73aec827-612c-499e-967a-875acae31278 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:14.570640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-73aec827-612c-499e-967a-875acae31278 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052255 Dec 17 12:53:14.571197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 699/1395] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:15.171609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:15.172489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:15.181955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:15.182393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:15.183171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:15.183602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:15.326914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:15.338037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f49895f7-0d29-4d55-8a7c-15bbd8bf1803 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172810 Dec 17 12:53:15.338618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 697/1396] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:15 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:15.587488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7ffd015-cefb-4885-9de0-ae808edd1df6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e00ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:15.645143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7ffd015-cefb-4885-9de0-ae808edd1df6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064425 Dec 17 12:53:15.645704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 700/1397] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:16.359493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:16.360575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:16.371208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:16.371984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:16.373257 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:16.374031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:16.519791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:16.532209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-357063d3-ab5c-4674-a4e7-20f816e6ae64 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178814 Dec 17 12:53:16.533031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 698/1398] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:16.662262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3c3d1309-5bca-4ada-a784-0527fe14741b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:16.714932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3c3d1309-5bca-4ada-a784-0527fe14741b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059748 Dec 17 12:53:16.715506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 701/1399] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:17.555761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:17.556786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:17.563794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:17.564239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:17.565310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:17.565781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:17.705324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:17.717760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d17852ed-670b-46d4-b852-e510c36b5058 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168072 Dec 17 12:53:17.718584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 699/1400] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:17.728091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-724bf59f-92a3-438f-b7eb-8ad966d46521 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f93a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:17.777778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-724bf59f-92a3-438f-b7eb-8ad966d46521 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053659 Dec 17 12:53:17.778393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 702/1401] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:18.739832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:18.740768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:18.751481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:18.752303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:18.753607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:18.754326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:18.789961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-26f3d6af-e781-4938-bd52-d7a93f380d5c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11ef7af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:18.842910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-26f3d6af-e781-4938-bd52-d7a93f380d5c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056757 Dec 17 12:53:18.843479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 703/1402] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:18.888228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:18.896361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c76866bc-c8f1-4a0f-9bd8-1b5c40395b84 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162828 Dec 17 12:53:18.896941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 700/1403] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:19.855968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-42425dc3-237d-404c-9e22-c41db231cf45 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11221040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:19.903530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-42425dc3-237d-404c-9e22-c41db231cf45 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051735 Dec 17 12:53:19.904121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 704/1404] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:19.912955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:19.913574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:19.920219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:19.920667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:19.921477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:19.921906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:20.064717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:20.073136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-92edf795-cafc-4eb0-8d14-15cf67d4bfc7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163874 Dec 17 12:53:20.073765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 701/1405] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:20.917621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dc2cd138-8b25-4ab6-b855-d3f1a28115a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e965e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:21.090666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:21.091264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:21.098122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:21.098569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:21.099353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:21.099780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:21.133192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dc2cd138-8b25-4ab6-b855-d3f1a28115a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.219806 Dec 17 12:53:21.133952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 705/1406] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:21.244581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:21.252575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-db9ab669-be53-4d5c-af41-7d4e9ab76476 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165994 Dec 17 12:53:21.253125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 702/1407] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:21 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:22.150193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e4cc50a8-a453-4fbd-a5f5-63a6cea067f0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:22.205202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e4cc50a8-a453-4fbd-a5f5-63a6cea067f0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062006 Dec 17 12:53:22.205800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 706/1408] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:22.269203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:22.269822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:22.276536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:22.277037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:22.277867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:22.278304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:22.424708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:22.437010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a42efdc1-dc32-4a83-a038-a9ab19122a2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171201 Dec 17 12:53:22.437976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 703/1409] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:23.219595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-768320a0-f3e4-47cf-a177-277d2b9781ee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:23.266924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-768320a0-f3e4-47cf-a177-277d2b9781ee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052511 Dec 17 12:53:23.267485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 707/1410] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:23.458113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:23.458902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:23.468216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:23.468660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:23.469460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:23.469883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:23.612912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:23.623615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c952b98-02be-4342-b1e1-444d4adb5f7d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172109 Dec 17 12:53:23.624186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 704/1411] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:24.168914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:53:24.169353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:53:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:53:24.280173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8c1b593e-569c-4b7c-a2fd-ed0d9be1ebdc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d875e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:24.336854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8c1b593e-569c-4b7c-a2fd-ed0d9be1ebdc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060802 Dec 17 12:53:24.337468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 708/1412] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:24.645190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:24.645821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:24.652607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:24.653051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:24.653906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:24.654329 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:24.807199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:24.819066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6a366f43-0e40-412d-9069-c1c7efbdac79 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177002 Dec 17 12:53:24.819066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 705/1413] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:24 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:25.352598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-af279d4a-f903-454c-9d71-d96cab963075 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:25.411344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-af279d4a-f903-454c-9d71-d96cab963075 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063504 Dec 17 12:53:25.411933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 709/1414] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:25.835378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:53:25.835831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:53:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed (ip 10.222.0.45) !!! Dec 17 12:53:25.850029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:25.850677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:25.859750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:25.860200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:25.860996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:25.861457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:26.017864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:26.030696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d1f768af-6324-4b65-a121-247d7ab7afc5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.196569 Dec 17 12:53:26.031566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 706/1415] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:26.428579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b095504c-4e81-42f2-86f7-f6dcc507617b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e790>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:26.479094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b095504c-4e81-42f2-86f7-f6dcc507617b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057551 Dec 17 12:53:26.479690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 710/1416] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:27.059788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:27.065347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:27.072877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:27.073361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:27.074888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:27.075331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:27.231709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:27.243120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eb4d792e-cb8f-4ee1-abaa-1cb37ef5fcf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.191412 Dec 17 12:53:27.244062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 707/1417] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:27.495470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e6cd83cf-dc58-4165-9d95-c4fc440de99b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db0940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:27.554154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e6cd83cf-dc58-4165-9d95-c4fc440de99b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065654 Dec 17 12:53:27.554725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 711/1418] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:28.263924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:28.264498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:28.271332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:28.271780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:28.272576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:28.272984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:28.425145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:28.434188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc5d93a2-e5da-476f-9022-1e37d889a5ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174316 Dec 17 12:53:28.434750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 708/1419] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:28 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:28.571164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8d9ebd6c-16c3-4949-a77d-64d705ee1583 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11228dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:28.625180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8d9ebd6c-16c3-4949-a77d-64d705ee1583 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061457 Dec 17 12:53:28.625770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 712/1420] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:29.348663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:53:29.348999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:53:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:53:29.452083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:29.452774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:29.459348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:29.459806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:29.460567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:29.460991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:29.597993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:29.608639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d4b0bef0-e3df-43bf-8a48-2139c03a27ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160098 Dec 17 12:53:29.609136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 709/1421] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:29.638343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a9b4a4f9-ca8d-49b6-9f14-511969de6cee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:29.684595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a9b4a4f9-ca8d-49b6-9f14-511969de6cee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050488 Dec 17 12:53:29.685214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 713/1422] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:30.628710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:30.629354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:30.636496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:30.636925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:30.637752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:30.638292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:30.700870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-01f405f7-c78f-4726-bb25-e82e44e95848 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e790>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:30.749565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-01f405f7-c78f-4726-bb25-e82e44e95848 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055315 Dec 17 12:53:30.750467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 714/1423] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:30.793998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:30.795863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f7af54db-9b93-4fc9-a786-3c369048f52c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170897 Dec 17 12:53:30.796485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 710/1424] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:31.763865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-55ac9014-d712-401b-a394-48f08362ed82 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112214c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:31.810720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-55ac9014-d712-401b-a394-48f08362ed82 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051963 Dec 17 12:53:31.811453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 715/1425] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:31.812195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:31.812706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:31.821149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:31.821637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:31.822434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:31.822869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:31.956307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:31.964268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5e403a97-1e91-4876-a2f6-ece19e54fccb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156050 Dec 17 12:53:31.964842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 711/1426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:32.824493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1741dff4-4a78-4cbe-9e4e-36a420b37085 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:32.871589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1741dff4-4a78-4cbe-9e4e-36a420b37085 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051323 Dec 17 12:53:32.872188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 716/1427] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:32.984585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:32.985375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:32.995876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:32.996528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:32.997775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:32.998375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:33.146311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:33.157727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-10ef5a05-ba94-43c9-b7f9-6eaed5443406 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.179164 Dec 17 12:53:33.158305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 712/1428] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:33.884144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7ff962d7-3eb9-4899-9609-c68a67d7bd8f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:33.935970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7ff962d7-3eb9-4899-9609-c68a67d7bd8f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055428 Dec 17 12:53:33.936628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 717/1429] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:34.178692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:34.179579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:34.190469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:34.191212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:34.192467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:34.193380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:34.331359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:34.339552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aca75d40-d966-4fc2-95c6-48c16dd16647 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167167 Dec 17 12:53:34.340129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 713/1430] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:34 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:34.950540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afa0f400-fbcc-45d6-85f6-bc74bde78565 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11228dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:34.998483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afa0f400-fbcc-45d6-85f6-bc74bde78565 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052960 Dec 17 12:53:34.999077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 718/1431] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:35.357839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:35.358451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:35.368288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:35.368903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:35.370191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:35.370747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:35.524619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:35.538530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2d2a181-3e10-49a7-afa9-e8422ea54b85 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.185507 Dec 17 12:53:35.539504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 714/1432] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:36.013885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac7cd9ee-2758-4c87-ba05-de60b99e4fa7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b3a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:36.072081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac7cd9ee-2758-4c87-ba05-de60b99e4fa7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063791 Dec 17 12:53:36.072649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 719/1433] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:36.560200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:36.561254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:36.571936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:36.572673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:36.574015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:36.574733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:36.717213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:36.725872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0083120c-17b2-4ada-97d4-1203ce11dc2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171887 Dec 17 12:53:36.726427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 715/1434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:37.089419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a37e8f79-31bd-42f2-88a1-6599d4e3574c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11228820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:37.144087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a37e8f79-31bd-42f2-88a1-6599d4e3574c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061601 Dec 17 12:53:37.144669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 720/1435] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:37.745369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:37.746092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:37.754549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:37.755147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:37.756170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:37.756743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:37.889957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:37.898203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f8680636-57d2-4264-b9e7-3c41fc7ee817 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157953 Dec 17 12:53:37.898810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 716/1436] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:37 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:38.160968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-32d38b06-b650-434c-9d99-aa75b8cd012a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e36af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:38.211480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-32d38b06-b650-434c-9d99-aa75b8cd012a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057323 Dec 17 12:53:38.212036 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 721/1437] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:38.919930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:38.920602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:38.926875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:38.927333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:38.928231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:38.928647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:39.078633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:39.086499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31a82edf-92c4-415a-ab46-da722bca56bd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170304 Dec 17 12:53:39.087075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 717/1438] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:39.224026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-47277e8c-77a3-47c2-82c3-469e744e07b0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bf70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:39.274747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-47277e8c-77a3-47c2-82c3-469e744e07b0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054783 Dec 17 12:53:39.275324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 722/1439] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:40.107355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:40.107898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:40.115723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:40.116174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:40.116952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:40.117427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:40.255334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:40.263398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-21a9842e-3b51-4077-a155-482429d8a725 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162226 Dec 17 12:53:40.263951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 718/1440] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:40 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:40.287443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-332593f3-0cdb-4dd3-8af3-c1aa691b1bfc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11221940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:40.339176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-332593f3-0cdb-4dd3-8af3-c1aa691b1bfc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055918 Dec 17 12:53:40.339738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 723/1441] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:53:41.284041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:41.285068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:41.294508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:41.294508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:41.294508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:41.294508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:41.352353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-56157947-8321-46dd-84da-2e2b886855c4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbf280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:41.401087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-56157947-8321-46dd-84da-2e2b886855c4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052861 Dec 17 12:53:41.407357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 724/1442] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:41.429264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:41.437026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30d35edf-11f8-4fde-8357-bd8e1eab1dba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159334 Dec 17 12:53:41.437859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 719/1443] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:42.415888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-91e4c111-81bf-4422-8f12-eaee8b2f55e4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:42.457119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:42.457724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:42.464542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:42.464978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:42.465881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:42.466314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:42.473479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-91e4c111-81bf-4422-8f12-eaee8b2f55e4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062243 Dec 17 12:53:42.474033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 725/1444] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:42.606115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:42.614714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-950d051d-fb96-41f1-ba18-c452f918b47e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163678 Dec 17 12:53:42.615274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 720/1445] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:43.490684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-81317fc1-384d-4740-950c-bcc429e1b4dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:43.542408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-81317fc1-384d-4740-950c-bcc429e1b4dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058897 Dec 17 12:53:43.542994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 726/1446] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:43.635269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:43.636313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:43.646889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:43.647335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:43.648113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:43.648542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:43.783853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:43.792422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66568359-140c-4dc5-b369-d12fc6ee8b2f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163302 Dec 17 12:53:43.793003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 721/1447] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:43 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:44.556961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-09ea155f-e041-464f-bcce-e0c97178cf61 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112213a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:44.603883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-09ea155f-e041-464f-bcce-e0c97178cf61 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051494 Dec 17 12:53:44.604535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 727/1448] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:44.813454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:44.814321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:44.822523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:44.822946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:44.823724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:44.824155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:44.970879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:44.979185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-80c8b6fc-0867-467d-9a8a-0d8e32f4836a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171688 Dec 17 12:53:44.979763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 722/1449] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:44 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:45.620886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-975b6189-9252-46b2-aab8-4e873deb4f41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:45.672171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-975b6189-9252-46b2-aab8-4e873deb4f41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058156 Dec 17 12:53:45.672979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 728/1450] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:46.000436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:46.001544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:46.012010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:46.012751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:46.014054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:46.014764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:46.151727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:46.163304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-313acef1-6ac7-45b8-99e6-d2d1b14e3ce5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169149 Dec 17 12:53:46.163875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 723/1451] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:46.688546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8ccfee91-8651-45f8-bd6e-2c03b326dc6a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112285e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:46.744477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8ccfee91-8651-45f8-bd6e-2c03b326dc6a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062773 Dec 17 12:53:46.745045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 729/1452] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:47.183858 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:47.184848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:47.194866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:47.195340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:47.196128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:47.196548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:47.325882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:47.333811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a0dc848-dc2b-49e7-9fed-6454cdf3d0a6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156275 Dec 17 12:53:47.334387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 724/1453] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:47.759330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b2da730b-4e45-46ef-96ff-b83fb881c42c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:47.808562 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b2da730b-4e45-46ef-96ff-b83fb881c42c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055050 Dec 17 12:53:47.810781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 730/1454] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:48.355031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:48.355980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:48.366148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:48.366578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:48.367348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:48.367767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:48.500770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:48.509370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-df4c34a5-a01b-4ca6-af27-3a0c18088046 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160604 Dec 17 12:53:48.509987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 725/1455] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:48.822375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30e1f40d-9902-4728-9c49-e205b196eb34 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:48.869374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30e1f40d-9902-4728-9c49-e205b196eb34 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051742 Dec 17 12:53:48.869950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 731/1456] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:49.526544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:49.527829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:49.535455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:49.535868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:49.536651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:49.537116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:49.669617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:49.677651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1c107484-4dbc-49cb-a35f-ec01238f66c2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.154799 Dec 17 12:53:49.678231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 726/1457] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:49 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:49.886374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f33a3638-11b1-4aec-a0d0-2ffd7829dffb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:49.935998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f33a3638-11b1-4aec-a0d0-2ffd7829dffb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056499 Dec 17 12:53:49.936564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 732/1458] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:50.698492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:50.699418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:50.709313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:50.709773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:50.710536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:50.710957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:50.851925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:50.860136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c80ab89e-a10c-4785-a289-05980c23bc89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167909 Dec 17 12:53:50.860720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 727/1459] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:50 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:50.949218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b62dc30d-68a9-4d97-b08a-faae7be5f309 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3ba60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:51.000400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b62dc30d-68a9-4d97-b08a-faae7be5f309 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055688 Dec 17 12:53:51.000978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 733/1460] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:51.880707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:51.881804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:51.892529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:51.893309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:51.894602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:51.895315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:52.012356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b986e3bb-f0e5-4b30-a759-2dcbed6f79f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e368b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:52.021860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:52.030408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3580bde4-d539-4233-8899-95baf8c79bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.155752 Dec 17 12:53:52.030994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 728/1461] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:52.058462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b986e3bb-f0e5-4b30-a759-2dcbed6f79f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050206 Dec 17 12:53:52.059095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 734/1462] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:53.051299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:53.052383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:53.063098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:53.063846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:53.065183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:53.065972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:53.072634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4081d0ec-08b4-41eb-a692-04e2cab24dfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbfc10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:53.120848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4081d0ec-08b4-41eb-a692-04e2cab24dfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052175 Dec 17 12:53:53.121403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 735/1463] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:53.207366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:53.215578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eceeec14-56c5-431e-a26a-bc852296d73a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170609 Dec 17 12:53:53.216505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 729/1464] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:53 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:54.135010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8e15ffa2-c734-43d9-8b36-283b68e48dd3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:54.183401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8e15ffa2-c734-43d9-8b36-283b68e48dd3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053147 Dec 17 12:53:54.188477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 736/1465] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:54.231914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:54.232507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:54.239023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:54.239471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:54.240297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:54.240723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:54.372965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:54.380943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c99f3a2a-c323-4ed2-b4a4-53f511ba296b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.152652 Dec 17 12:53:54.381564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 730/1466] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:55.200738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b5215df1-ed3f-416b-a5a9-c0963dde024a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d70160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:55.252194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b5215df1-ed3f-416b-a5a9-c0963dde024a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058693 Dec 17 12:53:55.252735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 737/1467] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:55.401569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:55.402738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:55.412802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:55.413251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:55.414109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:55.414540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:55.560115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:55.571095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-27cf183f-0296-470a-b5d9-0700a8039e31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175682 Dec 17 12:53:55.571673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 731/1468] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:55 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:56.268611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-375673d3-a478-462d-b473-3c967e2c6d6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120cee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:56.320472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-375673d3-a478-462d-b473-3c967e2c6d6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058731 Dec 17 12:53:56.321101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 738/1469] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:56.592335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:56.593332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:56.604156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:56.604897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:56.606239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:56.606995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:56.752061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:56.760184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8496e401-f7b1-4197-9d3c-3c933fe603d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174470 Dec 17 12:53:56.760722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 732/1470] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:56 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:57.337342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-18105fc3-c72c-4f8a-b901-233f1234a260 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bf70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:57.393092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-18105fc3-c72c-4f8a-b901-233f1234a260 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062645 Dec 17 12:53:57.393700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 739/1471] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:57.781017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:57.782136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:57.790538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:57.790979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:57.791757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:57.792186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:57.924082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:57.932664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c7a44ca-bd33-4ae3-be0f-dd6627a95a48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157938 Dec 17 12:53:57.933243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 733/1472] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:57 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:58.407238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5c9d92cd-81f3-49fa-872e-b74820e805cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f93a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:58.456947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5c9d92cd-81f3-49fa-872e-b74820e805cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054409 Dec 17 12:53:58.457551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 740/1473] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:53:58.953647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:58.954665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:53:58.965391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:58.966558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:58.967843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:53:58.968535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:53:59.107214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:53:59.115625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-934270c9-6fa5-47dd-b6a1-79c42ce0e115 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168309 Dec 17 12:53:59.116227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 734/1474] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:53:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:53:59.474260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1ff38a24-946c-49d6-8d8c-17e41d72e563 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e36a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:53:59.526258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1ff38a24-946c-49d6-8d8c-17e41d72e563 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058858 Dec 17 12:53:59.526817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 741/1475] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:53:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:00.136061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:00.137036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:00.147253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:00.147729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:00.148513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:00.148931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:00.288772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:00.297183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-124ab88f-b754-4d6c-9cce-f8dead0016ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167611 Dec 17 12:54:00.297794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 735/1476] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:00 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:00.543020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a323a44b-cca2-4775-800e-2bc1cc975d4b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:00.598837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a323a44b-cca2-4775-800e-2bc1cc975d4b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062829 Dec 17 12:54:00.603621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 742/1477] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:01.319796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:01.320522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:01.328745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:01.329318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:01.330285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:01.330870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:01.466803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:01.474637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ec5e12fe-c9b5-4613-b541-8fffd2339cb6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161042 Dec 17 12:54:01.475325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 736/1478] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:01 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:01.614319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eb7a0826-6914-45f2-aa37-720295f09bae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6ea60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:01.664218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eb7a0826-6914-45f2-aa37-720295f09bae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055855 Dec 17 12:54:01.664795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 743/1479] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:02.494314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:02.494975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:02.502624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:02.503139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:02.504019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:02.504551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:02.643574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:02.651932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-550e5ebe-711f-4b0f-b3b3-56e66cbfb729 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162663 Dec 17 12:54:02.652489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 737/1480] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:02 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:02.676418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-faf4b222-d81f-4470-a55f-bebbea620ee1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:02.722265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-faf4b222-d81f-4470-a55f-bebbea620ee1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049991 Dec 17 12:54:02.722867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 744/1481] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:03.669615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:03.670256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:03.677126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:03.677625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:03.678401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:03.678832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:03.735827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9f6348e9-3881-401f-b32b-64e115f228f9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:03.788787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9f6348e9-3881-401f-b32b-64e115f228f9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055890 Dec 17 12:54:03.795572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 745/1482] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:03.823742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:03.829884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ce33e35-c72b-4cc9-a87a-6f07b26b3452 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164368 Dec 17 12:54:03.830457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 738/1483] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:03 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:04.806608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-37a9ddb2-763a-402b-86e5-91cd7585b5ee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:04.848275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:04.848275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:04.854535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-37a9ddb2-763a-402b-86e5-91cd7585b5ee tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054237 Dec 17 12:54:04.854895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:04.855370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:04.856173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:04.856601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:04.860210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 746/1484] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:05.005598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:05.014443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a46e9585-eff6-4794-96e6-e8e590e444f6 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170772 Dec 17 12:54:05.015020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 739/1485] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:05.871452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7610d9ef-2763-44f6-a157-64dd3d965e40 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e36040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:05.921944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7610d9ef-2763-44f6-a157-64dd3d965e40 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056979 Dec 17 12:54:05.922509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 747/1486] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:06.036856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:06.038068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:06.048531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:06.049316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:06.050602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:06.051329 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:06.196986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:06.205223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5cbd1a8f-08fc-459b-b6a3-e126bb27ba9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175828 Dec 17 12:54:06.205859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 740/1487] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:06 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:06.937324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-74499e83-49c2-4d8a-9297-3817bbe0b6c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:06.990391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-74499e83-49c2-4d8a-9297-3817bbe0b6c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058714 Dec 17 12:54:06.990957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 748/1488] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:07.223261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:07.224049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:07.231160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:07.231592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:07.232402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:07.232816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:07.384800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:07.397558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77392a4f-9489-4109-a381-19b9fbe99bef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177950 Dec 17 12:54:07.398354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 741/1489] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:07 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:08.003695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d398dc51-47ad-4999-8032-7f34df4d2682 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:08.055293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d398dc51-47ad-4999-8032-7f34df4d2682 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055724 Dec 17 12:54:08.055913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 749/1490] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:08.414844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:08.415388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:08.422146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:08.422596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:08.423375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:08.423823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:08.559415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:08.567667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dfb4da95-ccc5-4bb6-b0a0-a1abc2ec1d24 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156620 Dec 17 12:54:08.568229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 742/1491] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:08 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:09.068389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-55b6fee4-36ac-46ba-ae05-6796facc0816 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c5e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:09.115499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-55b6fee4-36ac-46ba-ae05-6796facc0816 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051198 Dec 17 12:54:09.116100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 750/1492] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:09.584736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:09.585405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:09.592504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:09.593038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:09.593880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:09.594310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:09.732976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:09.741753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-86a3f237-616d-4951-be74-6fbd3b2cbd23 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160710 Dec 17 12:54:09.742304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 743/1493] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:09 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:10.128511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5269b78c-0e93-46ef-bb7a-769f9f8f7af8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:10.176566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5269b78c-0e93-46ef-bb7a-769f9f8f7af8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052258 Dec 17 12:54:10.177266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 751/1494] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:10.758241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:10.758846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:10.765790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:10.766237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:10.767032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:10.767466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:10.909997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:10.918189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-780b0b7f-555f-4b43-b78f-3d1b24f46f55 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163794 Dec 17 12:54:10.918770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 744/1495] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:10 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:11.189672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c6f7141b-9678-41ad-8d71-9ed67591f66b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d84160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:11.245464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c6f7141b-9678-41ad-8d71-9ed67591f66b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060006 Dec 17 12:54:11.246115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 752/1496] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:11.935570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:11.936200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:11.943621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:11.944069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:11.944862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:11.945314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:12.251290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:12.258425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4da6f512-a58d-4126-a376-d0eae1b40cfa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:12.259743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7726678e-32ba-4b83-b232-215cb830e071 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.328130 Dec 17 12:54:12.260379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 745/1497] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:12.307348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4da6f512-a58d-4126-a376-d0eae1b40cfa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052865 Dec 17 12:54:12.308055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 753/1498] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:13.278015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:13.278824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:13.285745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:13.286185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:13.286977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:13.287372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:13.320431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ca0e44e5-a32c-48fb-a628-6675e4071e81 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:13.370466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ca0e44e5-a32c-48fb-a628-6675e4071e81 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054144 Dec 17 12:54:13.375380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 754/1499] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:13.427011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:13.439006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a4f101d6-af72-46f0-9a2a-3ce55f8aaef3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165439 Dec 17 12:54:13.439857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 746/1500] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:14.383842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-128aedf4-5df5-4f79-8e25-150ac951e63e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:14.430728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-128aedf4-5df5-4f79-8e25-150ac951e63e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051198 Dec 17 12:54:14.431303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 755/1501] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:14.460081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:14.460759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:14.468807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:14.469252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:14.470066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:14.470466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:14.602553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:14.610943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce1a2ae0-3559-4a1c-803c-cff8f7a5d838 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.154680 Dec 17 12:54:14.611546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 747/1502] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:15.444392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c53549ec-b615-4032-a21e-9565605503ca tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c670>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:15.498710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c53549ec-b615-4032-a21e-9565605503ca tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058601 Dec 17 12:54:15.499371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 756/1503] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:15.629335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:15.630031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:15.636719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:15.637191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:15.637981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:15.638413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:15.778363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:15.789328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-72e8673b-758f-42d0-b0ca-b97a11770a07 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164002 Dec 17 12:54:15.789940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 748/1504] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:15 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:16.511941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1721d26d-6c2b-4ead-91dc-2b0bcd15d1a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:16.558838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1721d26d-6c2b-4ead-91dc-2b0bcd15d1a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050977 Dec 17 12:54:16.559405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 757/1505] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:16.806107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:16.806751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:16.814008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:16.814461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:16.815257 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:16.815691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:16.956196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:16.966633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-83b054da-4d67-4c44-a08f-4a4d230a7df4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163915 Dec 17 12:54:16.967344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 749/1506] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:17.572415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-37825fb1-be97-423f-a87f-193dd6a553e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113070d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:17.622690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-37825fb1-be97-423f-a87f-193dd6a553e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054331 Dec 17 12:54:17.623513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 758/1507] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:17.984129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:17.984731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:17.999247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:17.999688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:18.000463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:18.000884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:18.138348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:18.146584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-209c509a-80bb-4e60-a1cc-c5319dbef465 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166293 Dec 17 12:54:18.147168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 750/1508] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:18.636153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-40c51139-2acc-4429-894e-2793f6130e01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bc10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:18.683385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-40c51139-2acc-4429-894e-2793f6130e01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051453 Dec 17 12:54:18.683974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 759/1509] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:19.163886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:19.164528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:19.171460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:19.171891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:19.172694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:19.173108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:19.315661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:19.324948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-612e7d05-84a1-4cb1-b69d-c75c6eca18df tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164899 Dec 17 12:54:19.325864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 751/1510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:19.696747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2993313b-5b1d-45ae-b61e-27ac49e22192 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c5e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:19.753270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2993313b-5b1d-45ae-b61e-27ac49e22192 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060615 Dec 17 12:54:19.754117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 760/1511] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:20.343580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:20.344200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:20.350873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:20.351314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:20.352086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:20.352518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:20.503070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:20.511307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c0d2b5f-7821-4510-9083-8481960940d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171869 Dec 17 12:54:20.511864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 752/1512] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:20.774152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c15f4216-c122-49da-a8f0-390a32ce03f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:20.824785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c15f4216-c122-49da-a8f0-390a32ce03f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056231 Dec 17 12:54:20.826983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 761/1513] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:21.532366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:21.533372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:21.543975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:21.544687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:21.546255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:21.546976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:21.689129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:21.697055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d234c056-d078-4e12-adea-3a4c572d90f5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171008 Dec 17 12:54:21.697669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 753/1514] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:21 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:21.839628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-990f3c82-a3d3-48fd-81cd-c19d30d65614 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:21.885677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-990f3c82-a3d3-48fd-81cd-c19d30d65614 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050466 Dec 17 12:54:21.886238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 762/1515] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:22.718609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:22.719559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:22.730371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:22.731126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:22.732447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:22.732871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:22.880162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:22.888956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-828687b4-1de2-4b00-ac24-04e02f64b090 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177061 Dec 17 12:54:22.889573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 754/1516] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:22.898521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9ed732d0-e63f-4e7e-9aef-0f2d95b4e758 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:22.945411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9ed732d0-e63f-4e7e-9aef-0f2d95b4e758 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050926 Dec 17 12:54:22.950960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 763/1517] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:23.909934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:23.910823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:23.919022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:23.919530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:23.920390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:23.920813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:23.958620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f9e124a2-beb8-4368-b610-be272a5194dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:24.011681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f9e124a2-beb8-4368-b610-be272a5194dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057320 Dec 17 12:54:24.013333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 764/1518] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:24.084118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:24.092885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4701b087-ae85-4eea-b39e-4021c9166473 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.188847 Dec 17 12:54:24.093499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 755/1519] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:25.030030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b996222f-9d06-4aa2-b4e7-3545194a994c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:25.084089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b996222f-9d06-4aa2-b4e7-3545194a994c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060846 Dec 17 12:54:25.084672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 765/1520] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:25.110705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:25.111319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:25.118139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:25.118587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:25.119368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:25.119797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:25.265487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:25.274337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ef66a47-43fd-4cae-aa61-cac2908ed3e1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167539 Dec 17 12:54:25.274917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 756/1521] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:26.100680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-97e127b7-9811-4b47-9ea2-07334a982294 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:26.152316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-97e127b7-9811-4b47-9ea2-07334a982294 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058667 Dec 17 12:54:26.152884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 766/1522] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:26.291637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:26.292285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:26.299222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:26.299668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:26.300454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:26.300885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:26.441516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:26.451569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f2a11be-3a7d-481c-a2b0-d39cc060d2a7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163785 Dec 17 12:54:26.452161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 757/1523] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:27.168319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e890c33-29ca-41c8-af6c-4cccf94400f4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e401f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:27.225558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e890c33-29ca-41c8-af6c-4cccf94400f4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064031 Dec 17 12:54:27.226123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 767/1524] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:27.471816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:27.472392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:27.482447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:27.483045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:27.484332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:27.484999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:27.646907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:27.655632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16f51189-9891-4467-a735-460dbb764d2d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.187592 Dec 17 12:54:27.656247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 758/1525] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:28.238795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a10ff0eb-374e-4817-bfbc-690d53cd5671 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307c10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:28.287090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a10ff0eb-374e-4817-bfbc-690d53cd5671 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052541 Dec 17 12:54:28.287681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 768/1526] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:28.674138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:28.674747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:28.681536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:28.681978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:28.682750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:28.683147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:28.825147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:28.833635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3852247c-af1c-44db-a4c9-62fd3a485a58 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164196 Dec 17 12:54:28.834411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 759/1527] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:28 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:29.301173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cedeaad4-d37b-4449-b9d4-4d76fd90097b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:29.355053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cedeaad4-d37b-4449-b9d4-4d76fd90097b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059438 Dec 17 12:54:29.355609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 769/1528] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:29.854407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:29.855014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:29.865160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:29.865796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:29.867082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:29.867805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:30.002846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:30.015354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-14781c91-025a-4dcd-91f4-5d47992ac38a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166897 Dec 17 12:54:30.015902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 760/1529] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:30.367468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-88a4982f-5117-482a-81b4-feb74837c7b7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:30.426290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-88a4982f-5117-482a-81b4-feb74837c7b7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062881 Dec 17 12:54:30.427118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 770/1530] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:31.032774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:31.033500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:31.041844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:31.042405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:31.043676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:31.044362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:31.190641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:31.198713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ddd1a6c-f83e-4011-889f-cc79e02e47d1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169976 Dec 17 12:54:31.199290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 761/1531] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:31.439532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-239f7453-ea9a-4b05-bc57-57c7851ecc7c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b9d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:31.491035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-239f7453-ea9a-4b05-bc57-57c7851ecc7c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055538 Dec 17 12:54:31.491814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 771/1532] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:32.216833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:32.217406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:32.226506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:32.227240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:32.228569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:32.229313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:32.369856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:32.378295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-59f4d415-5d70-42be-b15b-8ff9f0834cf3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165955 Dec 17 12:54:32.378914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 762/1533] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:32.504683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b940a868-df13-4865-9137-eb46893518cd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:32.555776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b940a868-df13-4865-9137-eb46893518cd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055390 Dec 17 12:54:32.556309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 772/1534] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:33.397564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:33.398195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:33.404947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:33.405451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:33.406246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:33.406715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:33.549734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:33.558161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-004230da-6577-4284-ba83-eb4205fa895b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164385 Dec 17 12:54:33.558746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 763/1535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:33.568959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0bd71594-5d8a-42a7-8022-b09b226295c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d843a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:33.618550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0bd71594-5d8a-42a7-8022-b09b226295c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053568 Dec 17 12:54:33.619132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 773/1536] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:34.575053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:34.575702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:34.582545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:34.582979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:34.583773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:34.584196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:34.633334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-095f9c71-15ba-497d-bdf7-ae09576694dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:34.682956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-095f9c71-15ba-497d-bdf7-ae09576694dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054982 Dec 17 12:54:34.683840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 774/1537] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:34.752587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:34.761237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-276794a1-fba2-4a21-8ab6-1cb1ab644b4e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.190022 Dec 17 12:54:34.761890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 764/1538] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:34 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:35.696523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fdd67415-7ce5-43a3-9fb4-eaff9a3fed59 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:35.744986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fdd67415-7ce5-43a3-9fb4-eaff9a3fed59 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052675 Dec 17 12:54:35.750385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 775/1539] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:35.780818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:35.781590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:35.788602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:35.789050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:35.789897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:35.790324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:35.931383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:35.940470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-baf5e8b3-8d47-460d-9a96-8b5a670dcd32 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164181 Dec 17 12:54:35.941084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 765/1540] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:36.758220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-05e1f9db-83a2-4807-b914-964527331234 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e001f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:36.808589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-05e1f9db-83a2-4807-b914-964527331234 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054500 Dec 17 12:54:36.809168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 776/1541] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:36.958233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:36.958868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:36.966175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:36.966657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:36.967500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:36.967923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:37.110326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:37.118942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-70738bee-da46-4f99-9acb-6ee70751631c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164540 Dec 17 12:54:37.119573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 766/1542] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:54:37.822432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fb96d38d-a3b2-4020-8046-e84342e33801 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:37.871888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fb96d38d-a3b2-4020-8046-e84342e33801 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054245 Dec 17 12:54:37.872507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 777/1543] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:38.136304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:38.136873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:38.144375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:38.144820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:38.145644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:38.146077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:38.281255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:38.289888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e39458d2-94a2-4351-b3df-69fc9a0ed82e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157335 Dec 17 12:54:38.290473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 767/1544] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:38.885317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b6bdfb33-0c76-48ed-9a68-a45569103f8f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113180d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:38.932552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b6bdfb33-0c76-48ed-9a68-a45569103f8f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051354 Dec 17 12:54:38.933157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 778/1545] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:39.307256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:39.307865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:39.315066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:39.315516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:39.316308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:39.316738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:39.458441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:39.466831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-334df61d-6115-47dd-9f84-72f6ef0586ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163542 Dec 17 12:54:39.467425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 768/1546] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:39.945945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-49a36f21-149e-486c-b5a1-6fb008e877ac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbfe50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:40.003361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-49a36f21-149e-486c-b5a1-6fb008e877ac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061538 Dec 17 12:54:40.003934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 779/1547] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:40.484686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:40.485260 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:40.492142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:40.492592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:40.493479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:40.493928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:40.629294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:40.642965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4bbe41fd-dc4d-487a-b86d-114aa305bf3c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161890 Dec 17 12:54:40.644055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 769/1548] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:40 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:41.017526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-99244080-d2ba-487b-836d-f6d3843684ec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d875e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:41.069213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-99244080-d2ba-487b-836d-f6d3843684ec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056675 Dec 17 12:54:41.069811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 780/1549] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:41.666919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:41.667569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:41.675320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:41.675758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:41.677169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:41.677724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:41.826642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:41.834642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d94b06de-65bb-4ba5-a4ea-f315895e6b2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171500 Dec 17 12:54:41.835238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 770/1550] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:42.083323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c6166ff9-1086-44cc-be43-891a42b9bb6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:42.134775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c6166ff9-1086-44cc-be43-891a42b9bb6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055319 Dec 17 12:54:42.135656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 781/1551] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:42.853213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:42.853865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:42.861046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:42.861627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:42.862417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:42.862848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:43.022902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:43.031499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-060df841-9c5c-4aea-a61b-927b38ff200b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.182754 Dec 17 12:54:43.032067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 771/1552] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:43.151439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-34d2da7f-e627-44f0-91b2-557603e24b6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:43.206673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-34d2da7f-e627-44f0-91b2-557603e24b6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059468 Dec 17 12:54:43.207253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 782/1553] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:44.049894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:44.050682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:44.058337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:44.058775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:44.059594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:44.060039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:44.216504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:44.220317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61727651-f0cc-4bd4-ae1a-56905224d8d4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bdc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:44.225092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b8d34f1-e443-418c-8e81-d756a542ef16 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.179324 Dec 17 12:54:44.225713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 772/1554] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:44 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:44.272668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61727651-f0cc-4bd4-ae1a-56905224d8d4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056502 Dec 17 12:54:44.273338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 783/1555] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:45.244270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:45.244858 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:45.251902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:45.252360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:45.253144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:45.253600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:45.285515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b517e973-ee8f-4be3-b74a-68e484664438 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:45.337688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b517e973-ee8f-4be3-b74a-68e484664438 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056355 Dec 17 12:54:45.342992 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 784/1556] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:54:45.406576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:45.416039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-824d62c8-c567-4fd3-8a1f-d63c43189ad7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175178 Dec 17 12:54:45.416869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 773/1557] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:46.351312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d7d778f-5db8-4877-ba25-0f89e4a6c0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:46.400818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d7d778f-5db8-4877-ba25-0f89e4a6c0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053879 Dec 17 12:54:46.401384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 785/1558] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:46.436710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:46.437424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:46.446586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:46.447051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:46.447822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:46.448252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:46.601798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:46.610203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45d65a12-3952-4f65-8f7e-2f0a70f0b7ed tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178438 Dec 17 12:54:46.610808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 774/1559] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:46 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:47.414344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a900d9c9-d0dc-4d15-b518-601cc90c0a6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:47.470356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a900d9c9-d0dc-4d15-b518-601cc90c0a6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060317 Dec 17 12:54:47.470912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 786/1560] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:47.627889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:47.628509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:47.635244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:47.635685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:47.636460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:47.636882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:47.780890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:47.789311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1d37eb4c-1e5f-4abd-be38-80f063526392 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165231 Dec 17 12:54:47.789918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 775/1561] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:48.493130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-16b5cace-f6b8-407b-bb75-d0cac704955b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:48.543461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-16b5cace-f6b8-407b-bb75-d0cac704955b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054891 Dec 17 12:54:48.544042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 787/1562] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:48.809648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:48.810642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:48.820687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:48.821353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:48.822538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:48.823234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:48.964479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:48.974040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-835438e6-6262-4ecf-9218-dd84987a8810 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169960 Dec 17 12:54:48.974613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 776/1563] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:49.556379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b2e32425-073c-4053-9f4d-bbe2ae8b6e56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d703a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:49.603587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b2e32425-073c-4053-9f4d-bbe2ae8b6e56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051336 Dec 17 12:54:49.604197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 788/1564] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:49.992118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:49.992733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:49.999654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:50.000109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:50.000901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:50.001332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:50.147383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:50.158190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0303455f-678c-42cf-a289-0a206b263c22 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169518 Dec 17 12:54:50.159098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 777/1565] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:49 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:50.618712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e243b6d7-379e-43cf-bae4-9f808b63f465 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:50.673630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e243b6d7-379e-43cf-bae4-9f808b63f465 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061138 Dec 17 12:54:50.674209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 789/1566] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:51.177487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:51.178122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:51.185000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:51.185471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:51.186293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:51.186712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:51.332813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:51.341654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2468bc85-c49e-446f-a537-8c6243605705 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168035 Dec 17 12:54:51.342256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 778/1567] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:51.687115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e915111-87ee-4f2a-9ae7-247fd83aca32 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:51.738963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e915111-87ee-4f2a-9ae7-247fd83aca32 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055380 Dec 17 12:54:51.740127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 790/1568] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:52.360172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:52.360938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:52.367748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:52.368215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:52.369006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:52.369481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:52.512139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:52.520697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb18a64f-90c8-483b-b3e2-4e2f1a5ef291 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165146 Dec 17 12:54:52.521367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 779/1569] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:52 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:52.752927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ce921b79-c480-43d5-96c7-724df794fdbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11221700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:52.801091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ce921b79-c480-43d5-96c7-724df794fdbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052540 Dec 17 12:54:52.806127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 791/1570] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:53.538512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:53.539422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:53.546005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:53.546437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:53.547211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:53.547662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:53.687398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:53.695677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-390e4ad9-dfaa-4b57-8c5f-9e036193d7e5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161011 Dec 17 12:54:53.696235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 780/1571] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:53 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:53.814624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-331809bf-7d41-44d4-9f49-b088eeb743a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:53.863652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-331809bf-7d41-44d4-9f49-b088eeb743a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053369 Dec 17 12:54:53.864218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 792/1572] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:54.712826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:54.713480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:54.720044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:54.720481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:54.721940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:54.722366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:54.862374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:54.870860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f210e14-d647-41c6-87ab-60b6b43d2323 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161779 Dec 17 12:54:54.871452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 781/1573] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:54.876531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e042bdb0-65ac-41f1-8eec-98a1c5dc6c27 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:54.930219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e042bdb0-65ac-41f1-8eec-98a1c5dc6c27 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058073 Dec 17 12:54:54.930905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 793/1574] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:54:55.890864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:55.891741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:55.902332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:55.902686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:55.903750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:55.904390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:55.943208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8712578e-e1e4-4bce-8939-f56fe1417617 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e968b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:55.992282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8712578e-e1e4-4bce-8939-f56fe1417617 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053122 Dec 17 12:54:55.994170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 794/1575] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:56.041156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:56.049268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bf765186-2675-4135-9276-ac47746404f8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164399 Dec 17 12:54:56.049872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 782/1576] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:55 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:54:57.005527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3a1853e0-799a-447e-8a06-0e11bd2a9ed1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:57.052498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3a1853e0-799a-447e-8a06-0e11bd2a9ed1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051160 Dec 17 12:54:57.053088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 795/1577] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:57.066119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:57.066693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:57.073331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:57.074051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:57.074596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:57.075029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:57.211088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:57.220011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-750338ee-e8ef-42b6-b62c-4c7bc05b3a67 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157533 Dec 17 12:54:57.220592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 783/1578] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:57 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:58.069920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f35e860-fb0a-42fb-85df-871adec8716a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:58.127584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f35e860-fb0a-42fb-85df-871adec8716a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064569 Dec 17 12:54:58.128148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 796/1579] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:58.236905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:58.237709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:58.244199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:58.244664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:58.245511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:58.246066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:58.387232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:58.398542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-951d4056-4042-4ea4-b37f-ad532714c6da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164896 Dec 17 12:54:58.399615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 784/1580] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:54:59.143110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-449ee29a-2618-4064-a415-b7ea44110bb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e93ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:59.191325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-449ee29a-2618-4064-a415-b7ea44110bb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053982 Dec 17 12:54:59.191913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 797/1581] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:54:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:54:59.240641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:59.241207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:59.247989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.248497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.249314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.249757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.277464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 12:54:59.362600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e8b469d-7deb-4745-a156-616df523aa5f tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 204 len: 0 microversion: 2.20 time: 0.125056 Dec 17 12:54:59.363245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 785/1582] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Dec 17 12:54:59 2021] DELETE /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 17 12:54:59.371440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:59.372041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:59.378300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.378746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.379520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.379951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.430847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:54:59.431668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:54:59.438109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.438726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.439544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:54:59.440003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:54:59.516203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:59.524199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:59.525738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:59.527209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f8ffa470-3b72-4445-ac74-586e99bb5eae tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1722 microversion: 2.20 time: 0.159229 Dec 17 12:54:59.527475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 798/1583] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:54:59 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:54:59.581743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:54:59.595069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f840e720-3cf6-4906-a442-a82bc7a9f8e0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168320 Dec 17 12:54:59.595646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 786/1584] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:54:59 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:00.204265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0935364a-8d11-4892-9b11-9845ab15d1a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:00.251102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0935364a-8d11-4892-9b11-9845ab15d1a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050746 Dec 17 12:55:00.251772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 799/1585] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:00.545249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:00.545855 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:00.552293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:00.552740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:00.553554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:00.553987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:00.611626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:00.612215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:00.618244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:00.618733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:00.619551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:00.619974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:00.691190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:00.702570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:00.704185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9e6181feaf94cd588e4bbf25e87683a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a723dcdaae5c46c5b7e204c1557e581e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:00.705444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5aeea5ae-e320-4974-858f-2a542cf7cd9a tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 200 len: 1722 microversion: 2.20 time: 0.164028 Dec 17 12:55:00.706047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 787/1586] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:55:00 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 17 12:55:00.840260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:00.848550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-28e5b571-68c2-4a47-9c38-a6c6c5e229fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.241070 Dec 17 12:55:00.849256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 800/1587] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:00 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:01.156985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-83a7e01d-6196-474f-af0f-726c98d2aa67 req-41a6a35a-1c7a-4fad-9ec1-a0284b8a8cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b", "name": "network-vif-deleted", "tag": "9eddf42a-bcbd-4825-af1a-32d5485af3b9"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 12:55:01.158882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 12:55:01.158882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 12:55:01.166512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-83a7e01d-6196-474f-af0f-726c98d2aa67 req-41a6a35a-1c7a-4fad-9ec1-a0284b8a8cf0 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:01.166954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-83a7e01d-6196-474f-af0f-726c98d2aa67 req-41a6a35a-1c7a-4fad-9ec1-a0284b8a8cf0 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:01.178802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-83a7e01d-6196-474f-af0f-726c98d2aa67 req-41a6a35a-1c7a-4fad-9ec1-a0284b8a8cf0 service nova] Creating event network-vif-deleted:9eddf42a-bcbd-4825-af1a-32d5485af3b9 for instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b on hv-cinder-80152 Dec 17 12:55:01.184096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-83a7e01d-6196-474f-af0f-726c98d2aa67 req-41a6a35a-1c7a-4fad-9ec1-a0284b8a8cf0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030907 Dec 17 12:55:01.184707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 788/1588] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 12:55:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:01.264661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bd40b12a-9803-4408-b38d-328061affa4c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113189d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:01.328900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bd40b12a-9803-4408-b38d-328061affa4c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.068576 Dec 17 12:55:01.329789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 801/1589] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:01.725948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:01.726578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:01.732853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:01.733314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:01.734272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:01.734725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:01.748984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. Dec 17 12:55:01.749749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:55:01.750618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c37ef7b-bd38-4cde-8dfd-70f412eef569 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 404 len: 111 microversion: 2.20 time: 0.029474 Dec 17 12:55:01.751209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 789/1590] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 12:55:01 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:55:01.759588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-abeee517-6bad-4612-b9ba-607080b3c5d9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '.version_select at 0x7fba11221700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:01.784812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-abeee517-6bad-4612-b9ba-607080b3c5d9 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233957268" status: 204 len: 0 microversion: 2.20 time: 0.028751 Dec 17 12:55:01.785413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 802/1591] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Dec 17 12:55:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233957268 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 17 12:55:01.866541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:01.867157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:01.874907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:01.875046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:01.875917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:01.876342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:02.072698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:02.081263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c12af751-8e43-43ef-abcd-2c3c4a7e91c1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.219242 Dec 17 12:55:02.081901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 790/1592] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:01 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:02.342430 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-106f70bf-7697-4549-b16c-c54334e5128d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbfee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:02.391731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-106f70bf-7697-4549-b16c-c54334e5128d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053445 Dec 17 12:55:02.392527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 803/1593] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:03.102618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:03.103519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:03.111751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:03.112218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:03.113014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:03.113477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:03.254557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:03.262565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cf8188de-9b9f-47e2-84ad-265b0c9404fc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166153 Dec 17 12:55:03.263236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 791/1594] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:03 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:55:03.408773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ad9587c3-2254-4510-9fde-c1acd93a69dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e939d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:03.461587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ad9587c3-2254-4510-9fde-c1acd93a69dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059539 Dec 17 12:55:03.462163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 804/1595] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:04.286329 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:04.286996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:04.293964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:04.294454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:04.295274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:04.295840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:04.427273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:04.435397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-944565c0-4df9-423e-a276-b83ac6d799c9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.153272 Dec 17 12:55:04.435909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 792/1596] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:04.475304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-38212029-2293-4b05-a183-762a9586d77e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:04.532621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-38212029-2293-4b05-a183-762a9586d77e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061460 Dec 17 12:55:04.533202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 805/1597] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:05.456343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:05.457340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:05.468759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:05.469699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:05.470560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:05.470987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:05.545787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5baece3f-feb8-4a6a-b69b-b3aafa868859 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:05.593801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5baece3f-feb8-4a6a-b69b-b3aafa868859 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052163 Dec 17 12:55:05.594594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 806/1598] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:05.610624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:05.618570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f6ec3daa-833c-41f4-9408-ecd304d6df60 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168346 Dec 17 12:55:05.619246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 793/1599] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:05 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:06.607062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b5473097-32da-4cdf-b83e-56534797ac29 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d704c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:06.636287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:06.636931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:06.644010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:06.644456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:06.645259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:06.645725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:06.659460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b5473097-32da-4cdf-b83e-56534797ac29 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056589 Dec 17 12:55:06.660199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 807/1600] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:06.782070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:06.790843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-421b964f-2bc5-447f-9f32-cccec7da8bf8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158297 Dec 17 12:55:06.791539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 794/1601] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:06 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:07.673209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f7bc194e-6728-4f02-96e3-ccb2274240c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db0dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:07.722027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f7bc194e-6728-4f02-96e3-ccb2274240c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053497 Dec 17 12:55:07.728370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 808/1602] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:07.808669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:07.809687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:07.818025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:07.818471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:07.819287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:07.819720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:07.953047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:07.961583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d9deb8f-b341-4054-a1c2-c484b4f2c85b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157499 Dec 17 12:55:07.962175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 795/1603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:07 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:08.736297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-33e6c786-6649-44b0-a7bd-c9deaafdd88f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11228430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:08.785129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-33e6c786-6649-44b0-a7bd-c9deaafdd88f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053492 Dec 17 12:55:08.785743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 809/1604] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:08.980525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:08.981492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:08.988934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:08.989342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:08.990120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:08.990543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:09.136185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:09.146173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ab844af-a9fe-446b-8cae-edb435e39dcc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170213 Dec 17 12:55:09.147097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 796/1605] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:08 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:09.800014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f244b843-2acc-4889-8109-b953ce8b8832 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11221700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:09.854450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f244b843-2acc-4889-8109-b953ce8b8832 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059773 Dec 17 12:55:09.859359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 810/1606] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:10.169053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:10.169723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:10.179050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:10.179619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:10.180405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:10.180826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:10.318786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:10.327153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-63854352-d03b-4790-ba2b-0b85be3463f9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162889 Dec 17 12:55:10.327728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 797/1607] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:10 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:10.525258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 17 12:55:10.525720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:55:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:55:10.867133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8326b650-d877-406d-9b6e-218f3b780674 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113181f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:10.915623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8326b650-d877-406d-9b6e-218f3b780674 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052632 Dec 17 12:55:10.916204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 811/1608] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:11.348388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:11.349352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:11.356391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:11.356834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:11.357679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:11.358097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:11.503020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:11.511869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dceac22e-8f31-47e8-9ad3-7dd91d6417b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169568 Dec 17 12:55:11.512389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 798/1609] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:11.930847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-530a3b62-af2f-4a50-8f5a-43e9e1504132 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:11.981019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-530a3b62-af2f-4a50-8f5a-43e9e1504132 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055385 Dec 17 12:55:11.981989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 812/1610] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:12.534165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:12.535143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:12.544821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:12.545271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:12.546107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:12.546537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:12.683319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:12.695983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-76a4672b-6422-4b92-86d3-a511c6f08194 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166288 Dec 17 12:55:12.696898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 799/1611] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:12 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:12.993821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7e34c7b0-7e7b-4ec8-893e-fad56d325ea9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:13.045997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7e34c7b0-7e7b-4ec8-893e-fad56d325ea9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056345 Dec 17 12:55:13.049817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 813/1612] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:13.712823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:13.713800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:13.720611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:13.721058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:13.721886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:13.722316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:13.859432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:13.867939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-821d8b10-84ef-47a0-867f-bae21c3657eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158974 Dec 17 12:55:13.868565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 800/1613] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:14.058984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fca8cb4d-f34b-4feb-9a92-d9e89ed221fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e00b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:14.106751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fca8cb4d-f34b-4feb-9a92-d9e89ed221fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051857 Dec 17 12:55:14.107296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 814/1614] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:14.889224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:14.890049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:14.901025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:14.901821 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:14.903115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:14.903829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:15.047624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:15.055969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9bcc790e-9156-43e9-96ba-db855f628bd4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170509 Dec 17 12:55:15.056579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 801/1615] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:15.120082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-097703e5-fe36-4c2b-954e-03acdd699747 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:15.180721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-097703e5-fe36-4c2b-954e-03acdd699747 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065054 Dec 17 12:55:15.181319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 815/1616] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:16.072663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:16.073270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:16.080073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:16.080439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:16.081215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:16.081696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:16.192846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fb366a85-41a0-4b52-87b4-8edac0e5b99f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112214c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:16.224351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:16.232878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9b3898d-85a7-4db0-bc24-fe4723674aa1 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163917 Dec 17 12:55:16.233489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 802/1617] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:16.245150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fb366a85-41a0-4b52-87b4-8edac0e5b99f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056021 Dec 17 12:55:16.246297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 816/1618] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:17.250261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:17.250949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:17.257484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:17.257932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:17.258531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d6242016-6a2b-4049-a6a4-89ecde95d2a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:17.259001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:17.259129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:17.305638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d6242016-6a2b-4049-a6a4-89ecde95d2a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051166 Dec 17 12:55:17.311064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 817/1619] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:17.406518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:17.414716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-87665444-6a85-4a72-a06d-48a431bca1eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168229 Dec 17 12:55:17.415330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 803/1620] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:18.317746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5f63a04d-548a-4f66-91d7-721ad3c2bda3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:18.366951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5f63a04d-548a-4f66-91d7-721ad3c2bda3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053339 Dec 17 12:55:18.367551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 818/1621] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:18.431046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:18.431634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:18.438165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:18.438591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:18.439379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:18.439802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:18.581308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:18.589947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-29f97b4b-d288-4f52-90df-423205768f01 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162423 Dec 17 12:55:18.590551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 804/1622] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:19.379424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f83bbb5a-aa3b-448e-a542-8b57768601db tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:19.427528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f83bbb5a-aa3b-448e-a542-8b57768601db tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052427 Dec 17 12:55:19.428113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 819/1623] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:19.607259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:19.607863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:19.614688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:19.615136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:19.615951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:19.616379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:19.757849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:19.766139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-58e558ae-7143-4e91-9021-bdfc30eb4613 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162546 Dec 17 12:55:19.766708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 805/1624] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:20.443260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f5e037b5-6437-405e-8229-c56a1407f24d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e939d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:20.492788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f5e037b5-6437-405e-8229-c56a1407f24d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056412 Dec 17 12:55:20.493384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 820/1625] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:20.782956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:20.783564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:20.790096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:20.790549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:20.791337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:20.791766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:20.931363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:20.940617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e869b19-d978-49a7-a9f1-20e246c7aa56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161175 Dec 17 12:55:20.941222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 806/1626] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:21.507393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b7d75c60-1c7d-4bbb-a74c-7e19f0b83d5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:21.556360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b7d75c60-1c7d-4bbb-a74c-7e19f0b83d5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054165 Dec 17 12:55:21.556949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 821/1627] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:22.009637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:22.010549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:22.021685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:22.022432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:22.023718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:22.024438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:22.169922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:22.178455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28167a83-ab5b-457c-93ad-40bf58539726 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172776 Dec 17 12:55:22.179078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 807/1628] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:22.571772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5d147397-c0af-468a-b524-72d1dc0509a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e93940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:22.622457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5d147397-c0af-468a-b524-72d1dc0509a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055591 Dec 17 12:55:22.623078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 822/1629] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:23.195769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:23.196339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:23.204514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:23.204959 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:23.205799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:23.206231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:23.346995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:23.358902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a385543-ea51-4448-8caa-3e42c7ef8edd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166625 Dec 17 12:55:23.359564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 808/1630] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:23.635234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-77fbc73e-32ec-4fbb-937b-46df84854bde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:23.683786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-77fbc73e-32ec-4fbb-937b-46df84854bde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052662 Dec 17 12:55:23.684377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 823/1631] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:24.375836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:24.376489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:24.383337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:24.383774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:24.384550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:24.384971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:24.518932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:24.531317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e3edbc2-89cd-4f1f-8f0e-188c39206404 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158958 Dec 17 12:55:24.532224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 809/1632] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:24 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:24.696629 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d61f492-acd2-4a1a-b551-0e30e9a52d3b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:24.745132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d61f492-acd2-4a1a-b551-0e30e9a52d3b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052258 Dec 17 12:55:24.746430 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 824/1633] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:25.554168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:25.554787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:25.561596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:25.562003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:25.562814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:25.563266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:25.705079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:25.716428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07143706-e506-4e84-abbb-137a0444a431 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167530 Dec 17 12:55:25.717065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 810/1634] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:25.757926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76555322-b029-49cd-b515-b7940fcd081b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:25.805482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-76555322-b029-49cd-b515-b7940fcd081b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051726 Dec 17 12:55:25.805950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 825/1635] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:26.733681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:26.734256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:26.741578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:26.742027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:26.742818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:26.743244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:26.817694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8c4a3fb0-1ff7-4ab5-aab5-cca64cd1f0bb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d84ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:26.875032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8c4a3fb0-1ff7-4ab5-aab5-cca64cd1f0bb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061407 Dec 17 12:55:26.875633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 826/1636] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:26.885107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:26.895183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aa1d40db-3ed8-4fe1-9fc4-7e6dcd0ec39a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165169 Dec 17 12:55:26.895750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 811/1637] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:27.890019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d3db579b-45ab-4df5-ba96-a5b39ac72b4a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112ba310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:27.914388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:27.915132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:27.921452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:27.921892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:27.922674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:27.923099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:27.946119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d3db579b-45ab-4df5-ba96-a5b39ac72b4a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062105 Dec 17 12:55:27.946774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 827/1638] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:28.054258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:28.065991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-80f67882-aa52-481d-9f0e-dc848e68840c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156408 Dec 17 12:55:28.066688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 812/1639] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:55:28.958343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4bebf45-1cc1-4087-8f20-25bc9809d686 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11228d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:29.008952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4bebf45-1cc1-4087-8f20-25bc9809d686 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054650 Dec 17 12:55:29.009620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 828/1640] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:29.085144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:29.086345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:29.097546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:29.097546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:29.098215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:29.098714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:29.245901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:29.254362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9aa7cab-f453-4826-ae2a-78b55cc575eb tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174607 Dec 17 12:55:29.254970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 813/1641] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:30.023631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fc27bf41-92e0-46bb-aadb-6fcad19feb2d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:30.078610 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fc27bf41-92e0-46bb-aadb-6fcad19feb2d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060540 Dec 17 12:55:30.079242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 829/1642] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:30.271376 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:30.271980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:30.278740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:30.279181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:30.279960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:30.280387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:30.413880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:30.422469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b06ebee4-86b6-47d6-baaa-944db50615e2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.154669 Dec 17 12:55:30.423056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 814/1643] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:31.092084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dc792c65-655d-4d1f-b216-0c64acaa2d6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112baee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:31.141077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dc792c65-655d-4d1f-b216-0c64acaa2d6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053553 Dec 17 12:55:31.141678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 830/1644] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:31.441180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:31.441896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:31.448346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:31.448792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:31.449584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:31.450041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:31.587368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:31.596109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-630a8cc0-8c86-4402-9073-d6242918d201 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159054 Dec 17 12:55:31.596675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 815/1645] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:32.156439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e2ff5647-05c2-4daf-8a32-e6908ca79ce5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db0f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:32.204279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e2ff5647-05c2-4daf-8a32-e6908ca79ce5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051590 Dec 17 12:55:32.213506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 831/1646] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:32.614677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:32.615313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:32.622073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:32.622410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:32.623195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:32.623622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:32.754550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:32.763297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e40514fe-b7e0-478a-a780-342c4e391147 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.152334 Dec 17 12:55:32.763878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 816/1647] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:32.851960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:55:32.852240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:55:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:55:33.221771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5039f3db-d0c4-461a-a9c5-8b8818598022 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120cee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:33.268389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5039f3db-d0c4-461a-a9c5-8b8818598022 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050820 Dec 17 12:55:33.268959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 832/1648] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:55:33.780460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:33.781083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:33.788087 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:33.788534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:33.789317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:33.789776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:33.923045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:33.932059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-83634d02-d84d-4ea7-861d-5d0f563922f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.155326 Dec 17 12:55:33.932612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 817/1649] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:34.280518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-09abcd67-653f-45c3-a7f7-5b98ed2dc74c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e93940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:34.327827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-09abcd67-653f-45c3-a7f7-5b98ed2dc74c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051417 Dec 17 12:55:34.328383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 833/1650] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:34.950572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:34.951305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:34.957976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:34.958421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:34.959224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:34.959691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:35.112982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:35.121259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-60a4df55-7f1f-4dbc-9c1f-2047072d030d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174567 Dec 17 12:55:35.121877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 818/1651] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:34 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:35.341310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-77ea1a81-3878-4331-9a19-692067b73c45 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:35.389087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-77ea1a81-3878-4331-9a19-692067b73c45 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052325 Dec 17 12:55:35.389867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 834/1652] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:36.138737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:36.139500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:36.149352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:36.150096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:36.151335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:36.151767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:36.297229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:36.306029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fb4fac03-a531-4e2c-a8ea-502671000bf5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171446 Dec 17 12:55:36.306615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 819/1653] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:36.402566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fec39cf5-a30a-49eb-9ad5-c7eab24aec74 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113079d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:36.452393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fec39cf5-a30a-49eb-9ad5-c7eab24aec74 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054475 Dec 17 12:55:36.453123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 835/1654] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:37.323315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:37.323933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:37.330708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:37.331142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:37.331926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:37.332348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:37.465848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fd0fdc51-3439-48da-ab60-742a944cff6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:37.473605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:37.481867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5d7b6276-b925-47f7-8d00-dcbc41df8ef7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162406 Dec 17 12:55:37.482461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 820/1655] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:37 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:37.521686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fd0fdc51-3439-48da-ab60-742a944cff6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059833 Dec 17 12:55:37.522529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 836/1656] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:38.502342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:38.503170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:38.511240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:38.511687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:38.512480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:38.512913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:38.538299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2b3f0e9e-5c12-4a06-8c03-6dfdf523192d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e939d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:38.596473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2b3f0e9e-5c12-4a06-8c03-6dfdf523192d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064041 Dec 17 12:55:38.598268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 837/1657] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:38.657477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:38.670914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cb2ca4f8-852a-4b8a-b47e-f5599753e1a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174620 Dec 17 12:55:38.671611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 821/1658] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:39.614279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cee1f2b1-2408-4c38-8389-ca13fa7b530b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e40a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:39.664030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cee1f2b1-2408-4c38-8389-ca13fa7b530b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056638 Dec 17 12:55:39.667486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 838/1659] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:39.688218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:39.688824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:39.695565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:39.696007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:39.696806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:39.697231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:39.842442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:39.850891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fa9624e3-7f2c-46b5-8e57-f5b401238cd7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166374 Dec 17 12:55:39.851481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 822/1660] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:40.677628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20c5b6d3-5762-441e-a63e-1edbb6854c7d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db09d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:40.728179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20c5b6d3-5762-441e-a63e-1edbb6854c7d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055864 Dec 17 12:55:40.728782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 839/1661] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:40.869790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:40.870449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:40.877063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:40.877529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:40.878302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:40.878723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:41.015586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:41.025900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b5ddb26-6a2f-4f09-a4f3-dc5cd27e9044 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159914 Dec 17 12:55:41.026493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 823/1662] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:40 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:55:41.745438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a2cdc73f-1883-4412-80bc-f0225056f86a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:41.792195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a2cdc73f-1883-4412-80bc-f0225056f86a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051369 Dec 17 12:55:41.792770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 840/1663] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:42.044305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:42.044950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:42.051759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:42.052215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:42.053002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:42.053484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:42.195426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:42.208535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7e986934-a10c-444c-8c26-1eac0f8beb48 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167667 Dec 17 12:55:42.210558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 824/1664] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:42.804874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c5812ac6-b3ae-41f4-81c0-ba062dd239af tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:42.864636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c5812ac6-b3ae-41f4-81c0-ba062dd239af tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063955 Dec 17 12:55:42.865182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 841/1665] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:43.226891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:43.227490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:43.235145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:43.235875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:43.237158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:43.237896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:43.646207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:43.654803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a4ad830-8921-488a-ad03-6e144a2e0e5c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.431699 Dec 17 12:55:43.655389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 825/1666] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:43 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:43.877919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-03a00e1c-36a6-451d-9c49-a87d3a50482c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:43.925949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-03a00e1c-36a6-451d-9c49-a87d3a50482c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052344 Dec 17 12:55:43.926528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 842/1667] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:44.675297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:44.676296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:44.684450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:44.684898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:44.685815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:44.686248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:44.828118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:44.835762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c6b02d4e-3b39-4da0-9261-f92c9a960dfc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166938 Dec 17 12:55:44.836603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 826/1668] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:44 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:44.939436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d156475a-7382-44e1-b086-e5e31e2a0fa2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113189d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:44.990189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d156475a-7382-44e1-b086-e5e31e2a0fa2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054981 Dec 17 12:55:44.990762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 843/1669] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:45.853619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:45.854243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:45.861016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:45.861499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:45.862273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:45.862697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:45.999869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:46.002926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba0cc808-eeeb-49ae-9a44-616bd1481f43 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6eb80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:46.008514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06179aaf-1e57-4db8-8104-a44222e6dcba tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158397 Dec 17 12:55:46.009013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 827/1670] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:46.052682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba0cc808-eeeb-49ae-9a44-616bd1481f43 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053438 Dec 17 12:55:46.053606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 844/1671] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:47.027292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:47.028020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:47.034680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:47.035153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:47.036321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:47.036958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:47.068398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a1111006-6012-42a6-91e2-bc90318aa57b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db0d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:47.115789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a1111006-6012-42a6-91e2-bc90318aa57b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051503 Dec 17 12:55:47.116380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 845/1672] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:47.174997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:47.183188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7108fcbd-c686-4acf-8b81-1fe52bc56b1b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160752 Dec 17 12:55:47.183810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 828/1673] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:48.128722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a6279986-8519-43bb-8c42-7173d200ace4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:48.176073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a6279986-8519-43bb-8c42-7173d200ace4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051499 Dec 17 12:55:48.176650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 846/1674] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:48.200370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:48.201016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:48.207729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:48.208141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:48.208963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:48.209415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:48.340869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:48.349135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07290617-541e-4bf6-b730-1bf642e4c77d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.152758 Dec 17 12:55:48.349759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 829/1675] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:49.189304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a919ee5f-3811-4fd5-a984-dd1ad8512c06 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e670>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:49.250642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a919ee5f-3811-4fd5-a984-dd1ad8512c06 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065700 Dec 17 12:55:49.251218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 847/1676] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:49.369459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:49.370093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:49.376553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:49.377007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:49.377813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:49.378246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:49.521455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:49.529597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a067c4a7-e6db-44f8-9196-6f215dece299 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165354 Dec 17 12:55:49.530180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 830/1677] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:49 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:50.264023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2c4740d3-3947-4c84-a646-55d9b5400d33 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96c10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:50.311445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2c4740d3-3947-4c84-a646-55d9b5400d33 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051826 Dec 17 12:55:50.312017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 848/1678] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:50.546605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:50.547266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:50.553843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:50.554286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:50.555081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:50.555511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:50.698598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:50.710208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9952591-fc6d-4af5-8141-4ee62850f189 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167246 Dec 17 12:55:50.711122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 831/1679] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:50 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:51.324460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59bf4795-dddd-4fda-9c37-919009ef085d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113180d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:51.378050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59bf4795-dddd-4fda-9c37-919009ef085d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057770 Dec 17 12:55:51.378756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 849/1680] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:51.728419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:51.729014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:51.735723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:51.736170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:51.736966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:51.737436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:51.874617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:51.883388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8dc26c1c-6567-4dd5-bc89-e531c29a5ace tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158915 Dec 17 12:55:51.884121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 832/1681] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:52.393313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-91ea8095-586e-4050-9d03-180b8c90e552 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:52.445443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-91ea8095-586e-4050-9d03-180b8c90e552 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056809 Dec 17 12:55:52.446000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 850/1682] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:52.902003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:52.902597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:52.909600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:52.910049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:52.910842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:52.911268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:53.046298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:53.054725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3e609305-269d-4e4b-9b45-756beb6198de tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156465 Dec 17 12:55:53.055325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 833/1683] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:52 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:53.459703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b949b5e0-beab-4d0d-9701-33918bd07fc6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db0dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:53.507950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b949b5e0-beab-4d0d-9701-33918bd07fc6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052372 Dec 17 12:55:53.508497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 851/1684] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:54.072377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:54.073024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:54.082460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:54.082818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:54.083597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:54.084023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:54.232784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:54.241671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b4f4de2e-373a-4e8f-8c61-27103c532310 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.173073 Dec 17 12:55:54.242549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 834/1685] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:54.520731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6eb05d0e-11ee-4588-9a0a-7509b5c5fec9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11ef7790>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:54.570495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6eb05d0e-11ee-4588-9a0a-7509b5c5fec9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054041 Dec 17 12:55:54.571070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 852/1686] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:55.260357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:55.260937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:55.267835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:55.268276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:55.269039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:55.269502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:55.421844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:55.430518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-48005f6f-b916-4809-8473-b43a42611076 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174036 Dec 17 12:55:55.431233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 835/1687] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:55 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:55.583532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a5d1d55a-ea59-4a75-a06a-79d5b85b4837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:55.631798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a5d1d55a-ea59-4a75-a06a-79d5b85b4837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052387 Dec 17 12:55:55.632369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 853/1688] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:56.448173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:56.448766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:56.455597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:56.456044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:56.456846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:56.457306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:56.599535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:56.608359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-59f76e94-5c84-441b-a17e-4e86e24a8d77 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164044 Dec 17 12:55:56.608933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 836/1689] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:56 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:56.644538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-570b0bb9-b08d-4aa6-af74-ec1f19a1c059 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:56.691336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-570b0bb9-b08d-4aa6-af74-ec1f19a1c059 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050928 Dec 17 12:55:56.692001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 854/1690] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:57.626429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:57.627340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:57.634530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:57.634980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:57.635776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:57.636208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:57.704314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cf1b44f7-1088-4821-84af-6cf48d748cb2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113184c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:57.761325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cf1b44f7-1088-4821-84af-6cf48d748cb2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061136 Dec 17 12:55:57.761991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 855/1691] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:57.779640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:57.787816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-db681368-b8e4-4b4c-8f2a-f4abb9eacc9d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166321 Dec 17 12:55:57.788396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 837/1692] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:57 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:58.779037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a77ab786-5be0-4f0f-ba7e-3d4bee691ed6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e368b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:58.805123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:58.805806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:58.813957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:58.814439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:58.815493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:58.816034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:55:58.835808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a77ab786-5be0-4f0f-ba7e-3d4bee691ed6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063812 Dec 17 12:55:58.836572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 856/1693] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:58.959246 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:55:58.968952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd2daf4b-3eb4-4696-a949-aba35b6cd625 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167551 Dec 17 12:55:58.969622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 838/1694] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:55:59.849235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e1ef02ea-c01e-40bc-bf4b-2474ec5a2a23 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:59.897711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e1ef02ea-c01e-40bc-bf4b-2474ec5a2a23 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052640 Dec 17 12:55:59.898288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 857/1695] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:55:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:55:59.987675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:55:59.988649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:55:59.999228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:55:59.999970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:00.001269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:00.002047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:00.147078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:00.155705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5116f411-4d6c-4c1f-8684-cd58f691b66c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.173464 Dec 17 12:56:00.156597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 839/1696] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:55:59 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:00.911352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9058a624-06e4-4710-9fd6-143b215c4f85 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:00.958641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9058a624-06e4-4710-9fd6-143b215c4f85 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051375 Dec 17 12:56:00.959243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 858/1697] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:01.174168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:01.174760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:01.189836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:01.191145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:01.192488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:01.193233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:01.333589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:01.342247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2cd3ddd5-60e7-4b31-92bf-735432f6f540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172086 Dec 17 12:56:01.342861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 840/1698] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:01 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:01.972352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b56e8ea5-e23b-40c3-9e45-ad936b51d542 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d87a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:02.020715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b56e8ea5-e23b-40c3-9e45-ad936b51d542 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052477 Dec 17 12:56:02.021305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 859/1699] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:02.360026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:02.360628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:02.367245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:02.367686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:02.368481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:02.369035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:02.511635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:02.520562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4ddec84f-4add-469e-ba40-3ba467958632 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164600 Dec 17 12:56:02.521314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 841/1700] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:02 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:03.035250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-09a73696-f83a-4ef3-9841-bc656f936bde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11ef74c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:03.084495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-09a73696-f83a-4ef3-9841-bc656f936bde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054931 Dec 17 12:56:03.085152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 860/1701] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:03.538082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:03.538708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:03.545681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:03.546126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:03.546920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:03.549836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:03.701114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:03.709698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2933e25-b635-4776-a021-fe1b050802f3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175323 Dec 17 12:56:03.710291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 842/1702] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:03 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:04.097919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b4d5ab2e-1433-4a3f-b60a-1850bafdb17d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11318940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:04.148938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b4d5ab2e-1433-4a3f-b60a-1850bafdb17d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055209 Dec 17 12:56:04.149548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 861/1703] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:04.728074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:04.728711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:04.735491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:04.735939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:04.736745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:04.737167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:04.877151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:04.885958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1fea89d7-d1a6-429e-88d0-455fff2b5469 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161585 Dec 17 12:56:04.886578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 843/1704] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:05.164397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b01438f6-ecc2-4838-baa2-69954af4f921 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e36b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:05.213189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b01438f6-ecc2-4838-baa2-69954af4f921 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054121 Dec 17 12:56:05.214391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 862/1705] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:05.905933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:05.906566 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:05.914942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:05.915498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:05.916279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:05.916709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:06.058042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:06.066225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e68cd097-a6b2-489a-ac8d-82e9c818b35c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166427 Dec 17 12:56:06.066810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 844/1706] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:05 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:06.230124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ff59e87b-08f5-45b2-b036-3cbb747b7d95 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11307040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:06.281204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ff59e87b-08f5-45b2-b036-3cbb747b7d95 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058272 Dec 17 12:56:06.281892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 863/1707] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:07.084089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:07.084654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:07.091785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:07.092226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:07.092994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:07.093457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:07.231433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:07.239724 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-445fbee5-8ccc-4638-a960-c06e6477497e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159459 Dec 17 12:56:07.240295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 845/1708] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:07 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:07.297965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a614c59-bd43-4455-a180-27d5aff33889 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d849d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:07.350296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a614c59-bd43-4455-a180-27d5aff33889 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058863 Dec 17 12:56:07.350876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 864/1709] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:08.256906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:08.257528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:08.264392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:08.264838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:08.265665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:08.266095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:08.363269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30274b67-d863-49a6-affc-34634b953dbd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b6dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:08.403097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:08.411088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-386713c3-ee7f-455d-ac11-e9a6e3c9dd4d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157976 Dec 17 12:56:08.413668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30274b67-d863-49a6-affc-34634b953dbd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054794 Dec 17 12:56:08.414390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 865/1710] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:08.414548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 846/1711] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:08 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:09.428927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:09.429617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:09.433007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-04fcbcb7-fa37-4473-880c-d98ffcecad90 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba114101f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:09.436734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:09.437172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:09.437997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:09.438425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:09.484706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-04fcbcb7-fa37-4473-880c-d98ffcecad90 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055342 Dec 17 12:56:09.485287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 847/1712] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:09.591461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:09.599713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92e072bc-d0e7-45b5-bef0-b1091dc92c4f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174973 Dec 17 12:56:09.600615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 866/1713] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:09 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:10.497794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5943ec33-394c-45e2-a88e-b016008dc38e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:10.546015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5943ec33-394c-45e2-a88e-b016008dc38e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052277 Dec 17 12:56:10.546671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 848/1714] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:10.617866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:10.618644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:10.625778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:10.626344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:10.627414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:10.628109 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:10.766854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:10.775093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ee349d74-f03c-454d-9187-b7e9d7f94bf0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160997 Dec 17 12:56:10.775666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 867/1715] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:10 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:11.559393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-63ca2dcc-7557-4f0b-bb57-bc37cbb8946c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112ab310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:11.608113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-63ca2dcc-7557-4f0b-bb57-bc37cbb8946c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052984 Dec 17 12:56:11.608697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 849/1716] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:11.792331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:11.793112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:11.799774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:11.800224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:11.801019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:11.801472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:11.947392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:11.956758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bbab160f-0f85-4182-87c1-6de1d9463a38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168329 Dec 17 12:56:11.957373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 868/1717] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:12.621181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1d285d6-00df-4390-873f-7fe44bacba36 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f5e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:12.680086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1d285d6-00df-4390-873f-7fe44bacba36 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063001 Dec 17 12:56:12.684781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 850/1718] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:12.974775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:12.975352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:12.983025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:12.983553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:12.984238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:12.984670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:13.139387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:13.148617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a39d566e-f339-46af-b41b-682566ed8c14 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177699 Dec 17 12:56:13.149203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 869/1719] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:12 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:13.692743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6a8b7d15-1069-4766-8bd3-5e65006d9211 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:13.740047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6a8b7d15-1069-4766-8bd3-5e65006d9211 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051652 Dec 17 12:56:13.740680 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 851/1720] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:14.167209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:14.167850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:14.175783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:14.176242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:14.177035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:14.177501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:14.325862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:14.334641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-43a090e5-a709-4c25-8a23-15907fa7844a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171194 Dec 17 12:56:14.335214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 870/1721] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:14.753500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9b340a5c-50ab-49a7-be86-28c7f7a8f3c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:14.802355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9b340a5c-50ab-49a7-be86-28c7f7a8f3c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052976 Dec 17 12:56:14.803355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 852/1722] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:15.352483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:15.353099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:15.360298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:15.361002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:15.362316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:15.362812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:15.508697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:15.517352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2474d42d-ed3b-4ecf-b9fe-40c72e4a5227 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168659 Dec 17 12:56:15.517926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 871/1723] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:15 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:15.815407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77d0c430-9cbc-465a-ba7c-385286d579e4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:15.865778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77d0c430-9cbc-465a-ba7c-385286d579e4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054454 Dec 17 12:56:15.866357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 853/1724] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:16.537965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:16.538586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:16.545167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:16.545696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:16.546474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:16.546899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:16.680252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:16.693204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-01988c2d-38c2-4a07-bf72-4d14d83096b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158480 Dec 17 12:56:16.693936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 872/1725] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:16.881772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a8d61e99-ab31-49c3-9576-11501da80835 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f36e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:16.933798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a8d61e99-ab31-49c3-9576-11501da80835 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058826 Dec 17 12:56:16.934386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 854/1726] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:17.710967 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:17.711582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:17.719087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:17.719505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:17.720286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:17.720707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:17.879035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:17.890031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11faa0c7-252d-4c6c-bbf3-c215001084b0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.183004 Dec 17 12:56:17.890637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 873/1727] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:17.947408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f4eca747-6876-420d-acdb-08e9f8583cfe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f854c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:18.002699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f4eca747-6876-420d-acdb-08e9f8583cfe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059517 Dec 17 12:56:18.003519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 855/1728] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:18.907453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:18.908142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:18.916041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:18.916471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:18.917782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:18.918407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:19.016066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f6f8126-f419-4888-9603-593c3216ab2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:19.057203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:19.063907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f6f8126-f419-4888-9603-593c3216ab2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052229 Dec 17 12:56:19.064790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 856/1729] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:19.066896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a6f55e65-5a4a-4635-aed2-0e7c9c12dac4 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163270 Dec 17 12:56:19.067454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 874/1730] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:20.081382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a93656b5-4976-4db1-9854-607c848ae2c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:20.088459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:20.089969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:20.098015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:20.098979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:20.099411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:20.099861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:20.141301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a93656b5-4976-4db1-9854-607c848ae2c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062539 Dec 17 12:56:20.141301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 857/1731] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:20.240671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:20.251630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7062c55a-3cac-42f0-9bdc-13e0e81252fa tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170463 Dec 17 12:56:20.252650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 875/1732] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:21.150361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1be3056f-837e-4ce9-9710-b56ede88c76a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129dee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:21.204151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1be3056f-837e-4ce9-9710-b56ede88c76a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058074 Dec 17 12:56:21.204728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 858/1733] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:21.268221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:21.268889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:21.276572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:21.276902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:21.277746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:21.278296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:21.419449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:21.428033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9695679b-b0b7-40f8-9294-2c06ed86ee38 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163614 Dec 17 12:56:21.428648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 876/1734] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:21 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:22.217957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8861d0f2-0f01-401f-b288-1cc088351314 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b81f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:22.276927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8861d0f2-0f01-401f-b288-1cc088351314 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063302 Dec 17 12:56:22.277517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 859/1735] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:22.448480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:22.449518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:22.456446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:22.456879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:22.457695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:22.458095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:22.600667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:22.609348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-09be218d-6f74-4002-9b68-a116f207058e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166935 Dec 17 12:56:22.609941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 877/1736] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:23.291854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8058f073-f4ef-422e-97c6-cad7ede075c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f36e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:23.339287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8058f073-f4ef-422e-97c6-cad7ede075c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051668 Dec 17 12:56:23.344140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 860/1737] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:23.625995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:23.626589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:23.634424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:23.635043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:23.635978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:23.636408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:24.030101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:24.038666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6e81e7fa-0cf3-41e3-8aa4-471348cf5260 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.416627 Dec 17 12:56:24.039247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 878/1738] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:24.352475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5289a6b3-f29f-45e2-944c-07e4b10a45ce tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112930d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:24.409633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5289a6b3-f29f-45e2-944c-07e4b10a45ce tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061301 Dec 17 12:56:24.410213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 861/1739] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:25.055226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:25.055859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:25.063224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:25.063670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:25.064464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:25.064892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:25.208610 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:25.217685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-99e79e8e-fbfe-42c5-9a40-e2ef0842b1ce tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166183 Dec 17 12:56:25.218274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 879/1740] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:25.423602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2569d20b-6ea7-4916-8dbf-ed7224ed999f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11384ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:25.470764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2569d20b-6ea7-4916-8dbf-ed7224ed999f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051363 Dec 17 12:56:25.471343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 862/1741] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:26.235781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:26.236406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:26.243143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:26.243583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:26.244374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:26.244803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:26.386292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:26.395178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b046465a-f9f1-48d9-9077-74d1d62d4069 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163468 Dec 17 12:56:26.395760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 880/1742] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:26.486518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d032f5c1-883e-44b2-97ea-d4b6b832432c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:26.536865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d032f5c1-883e-44b2-97ea-d4b6b832432c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056928 Dec 17 12:56:26.537476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 863/1743] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:27.412699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:27.413332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:27.420317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:27.420767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:27.421605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:27.428507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:27.551377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b3283b92-7d3e-4688-b1a6-7ecb381a8f78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:27.578951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:27.588221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90b75825-cd9a-4596-a207-25bd2fd7ebc0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.179135 Dec 17 12:56:27.588894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 881/1744] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:27.608318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b3283b92-7d3e-4688-b1a6-7ecb381a8f78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061523 Dec 17 12:56:27.608895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 864/1745] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:28.605875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:28.606588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:28.613382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:28.613835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:28.614633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:28.615043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:28.620930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f59bbdc-f0a5-4232-baa8-f2b3b001ef2b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129de50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:28.668484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f59bbdc-f0a5-4232-baa8-f2b3b001ef2b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052290 Dec 17 12:56:28.669381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 865/1746] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:28.769553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:28.778219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-89c818da-6e97-4362-ba75-7a58d81deb56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.176115 Dec 17 12:56:28.778787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 882/1747] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:28 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:29.685227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6fe3e730-cbc3-42a9-ba3d-eadcdafb8a78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cb80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:29.732825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6fe3e730-cbc3-42a9-ba3d-eadcdafb8a78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053712 Dec 17 12:56:29.733577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 866/1748] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:29.795032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:29.795647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:29.802637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:29.803211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:29.803861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:29.804295 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:29.938963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:29.947369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cfb5b8b8-d06c-4e6f-ba01-77a06a3ea859 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.156176 Dec 17 12:56:29.947978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 883/1749] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:30.746134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-24daff53-3322-448c-90c5-033bd08d7b29 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:30.797254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-24daff53-3322-448c-90c5-033bd08d7b29 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055456 Dec 17 12:56:30.797870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 867/1750] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:30.964923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:30.965668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:30.972500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:30.972940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:30.973765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:30.974192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:31.116347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:31.125154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f5a4e48-44e3-42c0-945f-a1ef3c9e9586 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164258 Dec 17 12:56:31.125779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 884/1751] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:31.812196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-517a1169-3c59-4471-a430-f80722a54e43 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:31.858583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-517a1169-3c59-4471-a430-f80722a54e43 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051140 Dec 17 12:56:31.859137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 868/1752] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:32.142604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:32.143202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:32.149927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:32.150419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:32.151163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:32.151570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:32.298571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:32.308115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a8aa606-9043-4de3-be06-677bc53cdb21 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169374 Dec 17 12:56:32.308732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 885/1753] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:32.871738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0478d207-ce5d-459e-8a96-292ea7571229 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129de50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:32.919499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0478d207-ce5d-459e-8a96-292ea7571229 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052019 Dec 17 12:56:32.920103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 869/1754] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:33.325755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:33.326337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:33.333709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:33.334296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:33.335313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:33.335782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:33.470857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:33.479642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-93d9113d-659d-4ab0-a392-a280c361e93b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157613 Dec 17 12:56:33.480231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 886/1755] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:33.932635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-15203ccd-f733-47ef-8b74-871388a16782 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:33.982312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-15203ccd-f733-47ef-8b74-871388a16782 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053870 Dec 17 12:56:33.982881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 870/1756] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:34.497256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:34.497944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:34.504893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:34.505359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:34.506178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:34.506602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:34.644493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:34.655999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f646dc01-c796-4cd2-ac58-4a5598d06966 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162378 Dec 17 12:56:34.656798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 887/1757] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:34 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:34.995508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b1a81d1-1385-45cb-b11e-dc93fdfde860 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f6dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:35.043307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b1a81d1-1385-45cb-b11e-dc93fdfde860 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051932 Dec 17 12:56:35.043973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 871/1758] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:56:35.673319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:35.673957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:35.680773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:35.681211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:35.682019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:35.682452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:35.827343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:35.835503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5a1c5b52-1b1f-43d8-95c7-8e503012eb47 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165935 Dec 17 12:56:35.836077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 888/1759] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:36.056509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5542b182-519b-488b-9a5c-4666d3bbc6b7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:36.104868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5542b182-519b-488b-9a5c-4666d3bbc6b7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052444 Dec 17 12:56:36.105785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 872/1760] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:36.853270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:36.853895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:36.860767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:36.861240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:36.862030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:36.862465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:37.017519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:37.028073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-982ccda5-6bfe-4c4e-a3c1-efb8d2071c2b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178511 Dec 17 12:56:37.028662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 889/1761] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:37.118290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3975c302-52e5-469f-8192-5eaea9d6f49f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162635e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:37.169171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3975c302-52e5-469f-8192-5eaea9d6f49f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055224 Dec 17 12:56:37.169833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 873/1762] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:38.047129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:38.047770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:38.054637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:38.055079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:38.055870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:38.056301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:38.182129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2ad3b92-7323-474e-82cf-26acad5cc6fa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f36e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:38.196036 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:38.204209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1e9ad67d-3efd-4e16-9c45-7a01f8787fee tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161270 Dec 17 12:56:38.204776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 890/1763] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:38.230284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2ad3b92-7323-474e-82cf-26acad5cc6fa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052258 Dec 17 12:56:38.231138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 874/1764] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:39.221848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:39.222435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:39.229862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:39.230313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:39.231107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:39.231538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:39.242843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6beb032d-40c6-48ca-a89b-6e8d0ce9a082 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e31f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:39.292673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6beb032d-40c6-48ca-a89b-6e8d0ce9a082 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053130 Dec 17 12:56:39.294010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 875/1765] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:39.370712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:39.378706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a91bcd7-3e7b-477a-9cbb-40e74119a788 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160683 Dec 17 12:56:39.379293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 891/1766] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:40.306319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5322e92-3dbf-453f-9f04-d0eb161fd33e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:40.355128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5322e92-3dbf-453f-9f04-d0eb161fd33e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052891 Dec 17 12:56:40.355700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 876/1767] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:40.395694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:40.396307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:40.403081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:40.403536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:40.404332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:40.404770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:40.559045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:40.569793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-698c9ac7-105a-412d-afdd-1f7f694098ae tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177596 Dec 17 12:56:40.571228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 892/1768] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:40 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:56:41.368313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9317caa5-3237-4f1a-9508-81271aad81c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129d8b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:41.416317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9317caa5-3237-4f1a-9508-81271aad81c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052142 Dec 17 12:56:41.416906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 877/1769] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:41.590338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:41.590925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:41.598762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:41.598762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:41.599545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:41.600138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:41.742874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:41.751674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-67f2f515-b842-4941-8e49-a9a0a81868d3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165515 Dec 17 12:56:41.752236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 893/1770] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:42.432407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd6983cb-7802-4b29-bffb-af601f0dfd05 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163cb80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:42.489810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd6983cb-7802-4b29-bffb-af601f0dfd05 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061096 Dec 17 12:56:42.497443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 878/1771] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:42.772903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:42.773531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:42.783514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:42.783987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:42.785324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:42.785936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:42.935404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:42.944060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-145d3c90-71ed-46cf-ab2c-fa9c7e69e327 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177190 Dec 17 12:56:42.944909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 894/1772] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:43.507213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-71bf892c-1002-4cf5-acd4-299441ddcd8a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:43.559012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-71bf892c-1002-4cf5-acd4-299441ddcd8a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057594 Dec 17 12:56:43.559709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 879/1773] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:43.961431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:43.962113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:43.968962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:43.969442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:43.970233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:43.970630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:44.114075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:44.126075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7419d3e8-622a-438a-9d46-b9651476d19e tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168401 Dec 17 12:56:44.126966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 895/1774] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:43 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:44.193892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:56:44.194550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:56:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:56:44.573717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da02405a-e423-46bd-b564-53dfd0ae7837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:44.622529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da02405a-e423-46bd-b564-53dfd0ae7837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053095 Dec 17 12:56:44.627272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 880/1775] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:45.147367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:45.147997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:45.155166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:45.155609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:45.156430 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:45.156851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:45.293905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:45.302435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fb30ce29-d9b4-462b-9db1-3eaf57959959 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158750 Dec 17 12:56:45.303054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 896/1776] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:45.635049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a2b0c6f6-6e2a-4645-9c4f-3e7d90bbc6a7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11283670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:45.686143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a2b0c6f6-6e2a-4645-9c4f-3e7d90bbc6a7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055170 Dec 17 12:56:45.686714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 881/1777] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:45.868694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:56:45.868950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:56:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:56:46.319608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:46.320245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:46.326939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:46.327418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:46.328154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:46.328611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:46.466067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:46.474674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6255cc4c-3d2e-464c-97fd-92eb2da2fb68 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158806 Dec 17 12:56:46.475238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 897/1778] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:46 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:46.699957 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5d12d0c0-a0e9-4fec-8b50-d3f2b44db374 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129dee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:46.757601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5d12d0c0-a0e9-4fec-8b50-d3f2b44db374 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062567 Dec 17 12:56:46.758397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 882/1779] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:47.496005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:47.496609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:47.503410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:47.503863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:47.504650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:47.505080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:47.655148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:47.662917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-51a41317-a571-49fd-889b-6d7f5ff8238c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170466 Dec 17 12:56:47.663517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 898/1780] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:47.771186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-74c8cd11-acd4-4459-b3a3-a55d2589f31d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11471940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:47.821166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-74c8cd11-acd4-4459-b3a3-a55d2589f31d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054066 Dec 17 12:56:47.826053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 883/1781] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:48.679711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:48.680344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:48.688116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:48.688558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:48.689364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:48.689789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:48.828275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:48.833705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c9d7ab4f-a99a-4332-ab44-663ce3dcf658 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:48.837188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d77c533c-7857-4486-a8e7-2c9f78f40111 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161275 Dec 17 12:56:48.837832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 899/1782] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:48.879770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c9d7ab4f-a99a-4332-ab44-663ce3dcf658 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050103 Dec 17 12:56:48.880334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 884/1783] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:49.854511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:49.855166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:49.862074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:49.862521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:49.863313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:49.863744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:49.892521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dd4a9a75-d52e-4fd4-a8e1-2db473e3aa05 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112760d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:49.942587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dd4a9a75-d52e-4fd4-a8e1-2db473e3aa05 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054179 Dec 17 12:56:49.943316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 885/1784] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:50.007136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:50.015596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-db5186db-2777-4022-a8f8-dad002694c13 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164861 Dec 17 12:56:50.016417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 900/1785] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:49 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:50.955734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-26df87b5-242f-45bb-9801-524b52189e41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11634700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:51.006543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-26df87b5-242f-45bb-9801-524b52189e41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055060 Dec 17 12:56:51.007115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 886/1786] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:51.032635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:51.033237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:51.040148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:51.040607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:51.041526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:51.041965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:51.186172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:51.194380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e8fca747-4f95-4504-a96e-c90a95392af9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165960 Dec 17 12:56:51.194970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 901/1787] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:52.020748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-88632028-f9d5-4382-902e-4ec68a11e461 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11471940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:52.070244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-88632028-f9d5-4382-902e-4ec68a11e461 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053672 Dec 17 12:56:52.070811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 887/1788] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:52.213301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:52.213949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:52.223326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:52.223546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:52.224363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:52.224794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:52.358892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:52.367613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1fb10b9a-66a3-407b-abc9-2862bd0c1abe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158487 Dec 17 12:56:52.368193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 902/1789] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:52 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:53.082929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-de7bcbf7-cc78-4854-b5b8-bd7bb69049db tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129dd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:53.136037 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-de7bcbf7-cc78-4854-b5b8-bd7bb69049db tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057348 Dec 17 12:56:53.136646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 888/1790] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:53.384791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:53.385387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:53.392741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:53.393189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:53.394025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:53.394462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:53.532702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:53.542661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f35b4b6d-aa4b-4935-aaf0-2663b076872f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161648 Dec 17 12:56:53.543244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 903/1791] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:53 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:54.152191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b021ccf0-e1a7-4973-adfd-71ecfb05aaa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163c280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:54.199506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b021ccf0-e1a7-4973-adfd-71ecfb05aaa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054176 Dec 17 12:56:54.204435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 889/1792] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:54.560990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:54.561776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:54.568919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:54.569385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:54.570173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:54.570593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:54.719907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:54.730843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3fb4d752-62c5-4923-9813-79aaa2ec81da tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.174698 Dec 17 12:56:54.731498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 904/1793] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:55.213421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c5170db3-82d1-4f92-a797-4dbe56dae869 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:55.266682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c5170db3-82d1-4f92-a797-4dbe56dae869 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058214 Dec 17 12:56:55.267256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 890/1794] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:55.753365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:55.753991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:55.760568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:55.761006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:55.761814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:55.762239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:55.900465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:55.911744 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4646685f-78ab-40a7-9e36-cd6a4016840b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161818 Dec 17 12:56:55.912564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 905/1795] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:55 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:56.281167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f986093-95b5-4f56-b29c-0b17e8a55919 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:56.336296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f986093-95b5-4f56-b29c-0b17e8a55919 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060487 Dec 17 12:56:56.337096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 891/1796] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:56.931250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:56.931845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:56.939152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:56.939623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:56.940384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:56.940842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:57.084606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:57.094969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f00aa66-ebd2-4d91-a1a4-71967a5c6f5a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167459 Dec 17 12:56:57.095540 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 906/1797] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:56 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:57.348803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cc4fb4cf-30e7-4512-b29d-ef63d73506ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128ff70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:57.398831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cc4fb4cf-30e7-4512-b29d-ef63d73506ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054480 Dec 17 12:56:57.399407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 892/1798] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:58.120743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:58.120743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:58.127220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:58.127659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:58.128442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:58.128869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:58.278198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:58.287429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-480dec70-50e5-4a10-b22d-2c55b77af165 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171535 Dec 17 12:56:58.288236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 907/1799] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:58.412055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b506074a-758d-45ce-a598-c35d37ad3867 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11384ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:58.468939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b506074a-758d-45ce-a598-c35d37ad3867 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060855 Dec 17 12:56:58.473287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 893/1800] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:56:59.304391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:59.305025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:56:59.313985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:59.314434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:59.315260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:56:59.315695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:56:59.451090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:56:59.460027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7cc3ce58-47c4-4fb9-84ea-aa5324284a45 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159427 Dec 17 12:56:59.460599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 908/1801] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:56:59 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:56:59.481419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5607d98f-e2cc-44c6-ab29-56ac69067c39 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:56:59.526050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5607d98f-e2cc-44c6-ab29-56ac69067c39 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.048719 Dec 17 12:56:59.526605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 894/1802] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:56:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:00.477368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:00.477979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:00.484848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:00.485306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:00.486092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:00.486564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:00.538832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3373e428-6d3f-4f0d-ac84-18369fb0b5f2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:00.588114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3373e428-6d3f-4f0d-ac84-18369fb0b5f2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053479 Dec 17 12:57:00.588972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 895/1803] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:57:00.646095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:00.654253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c29ce7e6-e237-4cf3-be16-fb22afb07407 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.180718 Dec 17 12:57:00.655130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 909/1804] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:00 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:01.601799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-068d0486-d501-4289-b94f-c2fe78d1a2cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126edc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:01.659058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-068d0486-d501-4289-b94f-c2fe78d1a2cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061621 Dec 17 12:57:01.659646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 896/1805] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:01.671619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:01.672251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:01.679372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:01.679793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:01.680809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:01.681242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:01.819309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:01.828093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f735902c-5bc1-493c-8803-cc493150096a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160048 Dec 17 12:57:01.828688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 910/1806] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:01 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:02.672062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-15e2008a-b061-47a0-b5bf-f817ec43f0c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:02.720041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-15e2008a-b061-47a0-b5bf-f817ec43f0c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052274 Dec 17 12:57:02.720847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 897/1807] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:02.845823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:02.846402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:02.853087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:02.853563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:02.854341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:02.854769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:03.021683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:03.032092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f6410eb3-9bb7-4a99-a6be-49ff5f609003 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.190131 Dec 17 12:57:03.032678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 911/1808] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:02 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:03.734207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c62ba4f-f944-49dd-bd2c-45844540fef8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:03.786693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c62ba4f-f944-49dd-bd2c-45844540fef8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058067 Dec 17 12:57:03.787251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 898/1809] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:04.049666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:04.050317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:04.057142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:04.057612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:04.058531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:04.058958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:04.199536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:04.208077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59fc2801-6263-4806-b347-c726412f9d04 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162152 Dec 17 12:57:04.208637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 912/1810] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:04.800061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f06f406-9d95-406b-bdac-be2d0fbad212 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:04.849226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f06f406-9d95-406b-bdac-be2d0fbad212 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053465 Dec 17 12:57:04.849823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 899/1811] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:05.227280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:05.227873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:05.235319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:05.236014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:05.237131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:05.237644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:05.379996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:05.395564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1aa68ebb-5652-4ed1-8c3a-4960b90c3f49 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.173068 Dec 17 12:57:05.396159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 913/1812] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:05 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:05.861942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e9afaf32-4f52-42ce-bac3-828a9b57435e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:05.909742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e9afaf32-4f52-42ce-bac3-828a9b57435e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052092 Dec 17 12:57:05.910568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 900/1813] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:06.413251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:06.413917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:06.420700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:06.421144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:06.421997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:06.422404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:06.564745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:06.574728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3831187f-19ff-4133-9776-bef8d20a4e50 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165148 Dec 17 12:57:06.575317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 914/1814] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:06 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:06.925892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4fafeb80-620b-4357-995c-c373e2d4459c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130ce50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:06.988474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4fafeb80-620b-4357-995c-c373e2d4459c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.066659 Dec 17 12:57:06.989056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 901/1815] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:07.592925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:07.593545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:07.600392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:07.600836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:07.601661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:07.602093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:07.741043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:07.753508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0546fb19-bf1d-42b1-8641-5a53a1fe07ef tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164793 Dec 17 12:57:07.754100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 915/1816] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:07 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:08.001753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38815e9c-e690-4e4b-bef0-e22528878ae3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:08.063321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38815e9c-e690-4e4b-bef0-e22528878ae3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065916 Dec 17 12:57:08.063973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 902/1817] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:08.772265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:08.772902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:08.779687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:08.780179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:08.780945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:08.781411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:08.926752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:08.935175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c9d3f34f-ebee-497e-86bb-d3695315b11c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.166741 Dec 17 12:57:08.935766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 916/1818] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:08 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:09.080470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fcbfcee6-74bd-4201-bbfe-eb5ce1dabcb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:09.133353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fcbfcee6-74bd-4201-bbfe-eb5ce1dabcb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059866 Dec 17 12:57:09.133958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 903/1819] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:09.952588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:09.953216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:09.960130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:09.960572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:09.961761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:09.962193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:10.096466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:10.107490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d114fc13-ba9c-4f48-ae55-4c0a406e79a2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158327 Dec 17 12:57:10.108105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 917/1820] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:09 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:10.148358 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-50e65546-a494-4623-83ac-f9998d7f431b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:10.196002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-50e65546-a494-4623-83ac-f9998d7f431b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052979 Dec 17 12:57:10.196580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 904/1821] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:11.124935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:11.125537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:11.132504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:11.132948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:11.133756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:11.134182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:11.208968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c24d0dcd-f417-4449-abdd-0af73c63becb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:11.258900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c24d0dcd-f417-4449-abdd-0af73c63becb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054095 Dec 17 12:57:11.261032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 905/1822] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:11.280538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:11.289363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-51db67a5-10ca-4d71-a8d7-b0ca7c34b742 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168369 Dec 17 12:57:11.289968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 918/1823] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:12.274546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-edd6a885-7ee1-48ff-8a74-0ce6c7b50381 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112938b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:12.306609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:12.307871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:12.314386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:12.314832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:12.315619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:12.316226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:12.328658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-edd6a885-7ee1-48ff-8a74-0ce6c7b50381 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058771 Dec 17 12:57:12.329795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 906/1824] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:12.549004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:12.557176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7e162e8-7ef8-4c0b-b244-c30507cc3f5f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.254448 Dec 17 12:57:12.557790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 919/1825] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:12 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:13.346434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32d41abf-1fa7-44ea-9426-e8f6366bc577 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130ce50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:13.391579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32d41abf-1fa7-44ea-9426-e8f6366bc577 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051951 Dec 17 12:57:13.392168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 907/1826] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:13.575953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:13.576823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:13.585322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:13.586122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:13.586937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:13.587365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:13.733819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:13.743301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8c13d20-7efb-4579-8a40-a4e1dd73fa74 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172791 Dec 17 12:57:13.743881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 920/1827] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:14.408416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-34ac99d2-4033-4114-ae8e-98581f1a1104 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11634700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:14.460405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-34ac99d2-4033-4114-ae8e-98581f1a1104 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058920 Dec 17 12:57:14.461344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 908/1828] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:14.763963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:14.764817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:14.775963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:14.776878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:14.779919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:14.780667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:14.913818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:14.921748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e7329cf8-4289-41b9-84ed-fbe2616c67cd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164021 Dec 17 12:57:14.922322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 921/1829] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:15.477901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6509badc-0806-4755-9685-4b84add728b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162609d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:15.534707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6509badc-0806-4755-9685-4b84add728b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063853 Dec 17 12:57:15.535331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 909/1830] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:15.939867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:15.940493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:15.948221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:15.948687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:15.953148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:15.953148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:16.086468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:16.094339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0b3f9be0-7e1e-45a7-8e1c-de9f794bd25f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158442 Dec 17 12:57:16.094911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 922/1831] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:15 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:16.551373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b3b0ffbf-84bc-4949-81c3-da7d003f6da1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163c280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:16.603612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b3b0ffbf-84bc-4949-81c3-da7d003f6da1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058281 Dec 17 12:57:16.604179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 910/1832] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:17.115495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:17.116512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:17.126937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:17.127752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:17.129021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:17.130114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:17.269041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:17.277242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8e2a44a2-9105-4ed5-b645-9b3e54251f27 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168626 Dec 17 12:57:17.277872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 923/1833] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:17.616843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4d2a447a-1523-4740-8f55-3d1cb868aa47 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:17.665090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4d2a447a-1523-4740-8f55-3d1cb868aa47 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052336 Dec 17 12:57:17.665666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 911/1834] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:18.298290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:18.299451 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:18.307032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:18.307524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:18.308404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:18.308906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:18.453697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:18.462598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de24f62c-50e9-4782-86a1-b41a702cd44f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170427 Dec 17 12:57:18.463171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 924/1835] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:18.678408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d3796e6b-33a8-45e7-8429-d92f9afa3c6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112761f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:18.734133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d3796e6b-33a8-45e7-8429-d92f9afa3c6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059995 Dec 17 12:57:18.734706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 912/1836] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:19.483980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:19.484660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:19.491435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:19.491879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:19.492642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:19.493062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:19.631134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:19.639455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-04b1bcf1-df0e-4c51-9f4c-8fea0b53ee81 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159418 Dec 17 12:57:19.643541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 925/1837] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:19.747270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-901d866e-a726-4af5-acab-55c984da2ad3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:19.793702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-901d866e-a726-4af5-acab-55c984da2ad3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050415 Dec 17 12:57:19.794302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 913/1838] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:20.660410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:20.661209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:20.668078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:20.668530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:20.669301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:20.669774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:20.808802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52be1812-a1fc-41b9-996c-17b9ea7ee2ec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:20.823687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:20.831998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d3339edf-ddee-4a06-99c4-f654563ccc6a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.177441 Dec 17 12:57:20.832552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 926/1839] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:20.856389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52be1812-a1fc-41b9-996c-17b9ea7ee2ec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051800 Dec 17 12:57:20.857003 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 914/1840] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:21.849510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:21.850134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:21.856885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:21.857473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:21.858262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:21.858697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:21.868359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b4acaa8a-6664-412b-8f84-adeeeb578aa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112760d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:21.917443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b4acaa8a-6664-412b-8f84-adeeeb578aa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053196 Dec 17 12:57:21.918885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 915/1841] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:22.001614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:22.010045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-218f683f-9021-4676-98f8-b99cfd64a60a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164380 Dec 17 12:57:22.010627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 927/1842] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:21 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:22.930538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f1e827b-7658-4827-b9de-f17b8fbcd0f8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11384ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:22.980199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f1e827b-7658-4827-b9de-f17b8fbcd0f8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053916 Dec 17 12:57:22.980772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 916/1843] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:23.027892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:23.029315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:23.037587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:23.038210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:23.039197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:23.039722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:23.200469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:23.209454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2f9dfe37-097d-4ab0-b34f-9ff789ac9887 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.186213 Dec 17 12:57:23.210142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 928/1844] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:23.996911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-03f86a6a-703a-474b-9a3f-5724863cd837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ea60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:24.047337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-03f86a6a-703a-474b-9a3f-5724863cd837 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057210 Dec 17 12:57:24.048058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 917/1845] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:24.227389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:24.228013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:24.234706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:24.235155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:24.235941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:24.236375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:24.366202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:24.374090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-281e6e0d-c3c8-44e7-896c-d32b18cddf7c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.150467 Dec 17 12:57:24.374659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 929/1846] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:24 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:25.061538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c42939e6-9097-4b8a-b45e-7a5f092309b1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:25.113843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c42939e6-9097-4b8a-b45e-7a5f092309b1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056172 Dec 17 12:57:25.114704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 918/1847] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:25.395172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:25.396147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:25.406869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:25.407565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:25.408841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:25.409599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:25.551041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:25.559201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d1b5896f-e169-48db-84f6-03544f8c9669 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170032 Dec 17 12:57:25.559775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 930/1848] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:26.129528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-97176ada-5d55-4233-9b46-23a0df6e7a44 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:26.175936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-97176ada-5d55-4233-9b46-23a0df6e7a44 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052618 Dec 17 12:57:26.176513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 919/1849] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:26.576264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:26.576887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:26.583629 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:26.584122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:26.584917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:26.585689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:26.724432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:26.732535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-53724ddb-6b44-427c-bad9-389d4dab2615 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160199 Dec 17 12:57:26.733079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 931/1850] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:27.189186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-341a419f-bd1f-4e50-9d4f-18a193dfdc56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:27.236273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-341a419f-bd1f-4e50-9d4f-18a193dfdc56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051222 Dec 17 12:57:27.236847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 920/1851] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:27.749668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:27.750322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:27.757490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:27.757929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:27.758711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:27.759139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:27.897974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:27.905960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1c2f2478-19a1-42e2-9495-26ef05b6353d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160028 Dec 17 12:57:27.906576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 932/1852] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:28.249582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-394a51dd-f81f-43e1-bd6d-d10827c7e0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113158b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:28.298311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-394a51dd-f81f-43e1-bd6d-d10827c7e0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052836 Dec 17 12:57:28.298956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 921/1853] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:28.923272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:28.923875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:28.930692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:28.931139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:28.931911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:28.932341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:29.060015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:29.067954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2224faaa-16d2-4ef7-8486-a6e295d0d2ac tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.148479 Dec 17 12:57:29.068554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 933/1854] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:28 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:29.311306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c35a6e8d-f642-47c1-85ed-13d051d42252 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f65e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:29.357656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c35a6e8d-f642-47c1-85ed-13d051d42252 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050484 Dec 17 12:57:29.358302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 922/1855] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:30.085112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:30.086828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:30.094260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:30.094847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:30.095681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:30.096086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:30.234848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:30.245767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-54d260a0-22fd-45e2-a21a-7bddbb959220 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162962 Dec 17 12:57:30.245767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 934/1856] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:30.370962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ee407e8a-6a6d-41f4-8b4a-ef1ffd792509 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:30.418221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ee407e8a-6a6d-41f4-8b4a-ef1ffd792509 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051450 Dec 17 12:57:30.418800 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 923/1857] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:31.262622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:31.263489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:31.270116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:31.270564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:31.271366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:31.271796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:31.411307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:31.420051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d099dc2f-e36d-47d9-a494-39cb0bdded78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161971 Dec 17 12:57:31.420642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 935/1858] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:31.431312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1b0e590c-2129-496b-a917-14b0b2b21aaf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c5e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:31.486710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1b0e590c-2129-496b-a917-14b0b2b21aaf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059623 Dec 17 12:57:31.487281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 924/1859] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:32.437443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:32.438081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:32.445078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:32.445554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:32.446336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:32.446775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:32.499903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-56aa0ceb-47bc-42ce-842c-ff95a9f3e17d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11410670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:32.551913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-56aa0ceb-47bc-42ce-842c-ff95a9f3e17d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056146 Dec 17 12:57:32.558175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 925/1860] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:32.593977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:32.603873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-276fb322-c4d3-446e-807c-b34145c46f87 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170270 Dec 17 12:57:32.604447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 936/1861] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:33.565448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-efc5d1ef-266d-4769-a525-9b37fd19e3d1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:33.616172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-efc5d1ef-266d-4769-a525-9b37fd19e3d1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054857 Dec 17 12:57:33.616708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 926/1862] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:33.620150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:33.620961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:33.628147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:33.628708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:33.629675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:33.630129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:33.783487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:33.791750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de4abd80-39dc-4bdf-99f7-b3d64a740d61 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175541 Dec 17 12:57:33.792327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 937/1863] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:34.631618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9403f787-8c30-4448-b9ea-4d3a48f377f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f859d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:34.683243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9403f787-8c30-4448-b9ea-4d3a48f377f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058570 Dec 17 12:57:34.683812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 927/1864] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:34.808891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:34.809538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:34.818725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:34.819166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:34.819989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:34.820416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:34.955928 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:34.964803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d7965a4-44f5-4038-a9bb-e08b34ce7100 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160008 Dec 17 12:57:34.965774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 938/1865] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:34 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:35.696477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a0e12305-6ab7-4aba-9ea9-7bccda9beff2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f6dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:35.748099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a0e12305-6ab7-4aba-9ea9-7bccda9beff2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056006 Dec 17 12:57:35.748958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 928/1866] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:35.984970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:35.985566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:35.994672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:35.995389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:35.996672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:35.997429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:36.140381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:36.150074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cb1b1fb4-8421-47a6-bea1-c59bc4f7e4cc tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168934 Dec 17 12:57:36.150705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 939/1867] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:36.761611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e59dc8ac-8c43-4010-ba54-97c6622e69d9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ea60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:36.811864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e59dc8ac-8c43-4010-ba54-97c6622e69d9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054511 Dec 17 12:57:36.812447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 929/1868] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:37.166509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:37.167173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:37.173894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:37.174337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:37.175127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:37.175553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:37.321957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:37.336048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b916ce9f-cdad-4c67-b7e6-cb141c88006b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.173331 Dec 17 12:57:37.336632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 940/1869] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:37 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:37.829113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4bf1c828-685b-4122-b0df-cd499abdbfe0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129ddc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:37.884709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4bf1c828-685b-4122-b0df-cd499abdbfe0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062432 Dec 17 12:57:37.885308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 930/1870] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:38.353467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:38.354124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:38.360937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:38.361408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:38.362223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:38.362645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:38.505921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:38.514028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4566e6ad-08ac-4eb2-9d7d-b9af7e36eb41 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164509 Dec 17 12:57:38.514579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 941/1871] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:38.898044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f9ec7117-40bb-452b-95b6-bc1b495ab58d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1136b1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:38.947012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f9ec7117-40bb-452b-95b6-bc1b495ab58d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053070 Dec 17 12:57:38.947582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 931/1872] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:39.530583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:39.531403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:39.545845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:39.546294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:39.547090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:39.547545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:39.710013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:39.719176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-abb59528-e987-4603-b1b1-473ef004ce6d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.192144 Dec 17 12:57:39.719650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 942/1873] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:57:39.960882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2be03b8-10f8-4662-9fde-6c757007bca5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:40.009784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2be03b8-10f8-4662-9fde-6c757007bca5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053641 Dec 17 12:57:40.010678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 932/1874] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:40.737789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:40.738418 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:40.745941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:40.746388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:40.747187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:40.747630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:40.884573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:40.893126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-df35b99f-a476-46fe-9227-1fa513666b53 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160166 Dec 17 12:57:40.893716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 943/1875] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:40 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:41.025104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce9a10eb-9222-4889-82fd-4b1a4a8d78ab tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:41.087689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce9a10eb-9222-4889-82fd-4b1a4a8d78ab tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.067204 Dec 17 12:57:41.088533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 933/1876] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:41.912763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:41.913517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:41.920231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:41.920672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:41.921550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:41.921905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:42.070313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:42.078955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-417dbc58-67f9-42e6-ade1-437413716139 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171715 Dec 17 12:57:42.079474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 944/1877] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:42.102970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ab1be17-8b96-4ccc-8171-ae906fc39cde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163c280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:42.151974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ab1be17-8b96-4ccc-8171-ae906fc39cde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053210 Dec 17 12:57:42.152720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 934/1878] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:43.098266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:43.098847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:43.105971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:43.106381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:43.107177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:43.107605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:43.164795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38eadbbe-86ef-4224-9f35-1bd3d0e0f93c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126eee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:43.219366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38eadbbe-86ef-4224-9f35-1bd3d0e0f93c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058774 Dec 17 12:57:43.220161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 935/1879] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:43.257013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:43.265567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c05eeebe-663f-46c2-a2c7-08a931d8220b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170989 Dec 17 12:57:43.266233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 945/1880] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:43 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:44.232619 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7cb4099d-8b65-49a9-ad3e-ab70e8d6fecb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112801f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:44.280090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7cb4099d-8b65-49a9-ad3e-ab70e8d6fecb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051683 Dec 17 12:57:44.280649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 936/1881] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:44.282070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:44.282684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:44.289249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:44.289719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:44.290479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:44.290912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:44.420468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:44.428507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8ade3fc6-7485-42bc-a942-87a292d86833 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.150131 Dec 17 12:57:44.429048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 946/1882] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:44 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:45.295668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-32020dcd-c6ac-4512-aad5-980c6064f6cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e8b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:45.352421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-32020dcd-c6ac-4512-aad5-980c6064f6cf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062824 Dec 17 12:57:45.353071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 937/1883] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:45.446702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:45.447333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:45.454144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:45.454582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:45.455356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:45.455785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:45.593899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:45.608632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-71d77ff3-27af-4f93-a056-b3e891604c7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165814 Dec 17 12:57:45.609237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 947/1884] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 12:57:46.364935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b43fb08-6b14-43bd-b43d-0f01cc654dc2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163ce50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:46.417599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b43fb08-6b14-43bd-b43d-0f01cc654dc2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056755 Dec 17 12:57:46.418335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 938/1885] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:46.629809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:46.630719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:46.641456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:46.642214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:46.643481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:46.644181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:46.780093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:46.788996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6084d9cb-1382-480c-a43e-ee6618bc94b7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165490 Dec 17 12:57:46.789618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 948/1886] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:46 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:47.432395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ebcfe4d-8d7d-446e-84e8-702c54e34cff tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11280c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:47.537964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ebcfe4d-8d7d-446e-84e8-702c54e34cff tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.110094 Dec 17 12:57:47.538534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 939/1887] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:47.811101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:47.811709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:47.819816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:47.820254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:47.821030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:47.821503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:47.963210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:47.971885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d9c9792e-a246-44f5-a24b-d21ee4f7b9f2 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164510 Dec 17 12:57:47.972460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 949/1888] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:48.551074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c46b87e1-3f93-44ce-aaaf-46c88b7ae3c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:48.600578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c46b87e1-3f93-44ce-aaaf-46c88b7ae3c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053712 Dec 17 12:57:48.601896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 940/1889] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:48.989166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:48.989921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:48.996359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:48.996801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:48.997605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:48.998026 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:49.191065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:49.199627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-589e6481-17b9-4f24-b3ed-7c6562d1350d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.214186 Dec 17 12:57:49.200218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 950/1890] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:48 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:49.617477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8e9a2012-bd8a-4f81-9117-55dbe5bc4850 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba114101f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:49.671414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8e9a2012-bd8a-4f81-9117-55dbe5bc4850 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060137 Dec 17 12:57:49.671964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 941/1891] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:50.216818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:50.218094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:50.226858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:50.227676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:50.228471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:50.228900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:50.362263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:50.370327 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1a05b9b9-4ac4-4e92-bb58-a282b53afa7f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.157677 Dec 17 12:57:50.370915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 951/1892] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:50 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:50.688497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c670207-4bb0-4d72-9212-8c6ca7da4cb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:50.736130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c670207-4bb0-4d72-9212-8c6ca7da4cb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054559 Dec 17 12:57:50.736715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 942/1893] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:51.387767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:51.388365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:51.395301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:51.395748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:51.396530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:51.396963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:51.539241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:51.547151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-088e1afc-7a34-4247-b226-842282b92bc9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.163164 Dec 17 12:57:51.547760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 952/1894] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:51 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:51.748737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d1bbc86d-52fd-4324-8f6c-6078242cd4ba tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126edc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:51.798081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d1bbc86d-52fd-4324-8f6c-6078242cd4ba tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053638 Dec 17 12:57:51.798662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 943/1895] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:52.564351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:52.564955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:52.571760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:52.572193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:52.572967 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:52.573421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:52.702956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:52.711389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-592550f1-7d30-41e6-a03d-f07f43972e7a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.150810 Dec 17 12:57:52.711966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 953/1896] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:52 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:52.811518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd76d2cd-1fc8-48e7-bacb-79b5e53019a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:52.858368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd76d2cd-1fc8-48e7-bacb-79b5e53019a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051267 Dec 17 12:57:52.858943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 944/1897] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:53.728264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:53.728872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:53.735560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:53.736010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:53.736787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:53.737218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:53.871317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33007bc9-b26d-4af9-a72b-9588ec762efd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:53.876269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:53.885216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c392c47d-1743-483a-a188-f86fc83cca89 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160565 Dec 17 12:57:53.885614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 954/1898] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:53 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:53.917885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33007bc9-b26d-4af9-a72b-9588ec762efd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050545 Dec 17 12:57:53.918466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 945/1899] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:57:54.904389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:54.905073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:54.911649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:54.912070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:54.912869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:54.913305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:54.930669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb636564-2615-4903-b09f-e2e8ce9adb03 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:54.984686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fb636564-2615-4903-b09f-e2e8ce9adb03 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057985 Dec 17 12:57:54.993511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 946/1900] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:55.072371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:55.080571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cb2b8477-0ec9-493d-90d6-504908ee4540 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.181850 Dec 17 12:57:55.081086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 955/1901] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:54 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:56.001503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aab77149-1ea5-4e99-8a1f-9ab868b250bb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:56.047635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aab77149-1ea5-4e99-8a1f-9ab868b250bb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050516 Dec 17 12:57:56.048193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 947/1902] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:56.098673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:56.099338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:56.106450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:56.106890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:56.107667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:56.108093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:56.255216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:56.263611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-033a60e6-0ab2-45d7-a7ca-7846fe3b3244 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168676 Dec 17 12:57:56.264220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 956/1903] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:56 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:57.060844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-905ee723-db0e-40cd-a4ff-29e8e1fb3728 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:57.107496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-905ee723-db0e-40cd-a4ff-29e8e1fb3728 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050806 Dec 17 12:57:57.108091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 948/1904] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:57.281507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:57.282147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:57.288769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:57.289208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:57.290001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:57.290421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:57.418245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:57.426415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afc773b9-008b-47b1-9a3d-b65006624b1c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.148746 Dec 17 12:57:57.427002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 957/1905] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:57 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:58.120558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a705035-f572-46d6-996c-c916f77f7997 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:58.166870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a705035-f572-46d6-996c-c916f77f7997 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050577 Dec 17 12:57:58.167442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 949/1906] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:58.443608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:58.444196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:58.451004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:58.451441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:58.452210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:58.452632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:58.584009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:58.592834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-668abc05-c7b7-412c-9679-170651921019 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.153130 Dec 17 12:57:58.593453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 958/1907] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:58 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:57:59.180844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d103da0c-c989-480b-b338-056b5150da11 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:59.228797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d103da0c-c989-480b-b338-056b5150da11 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052829 Dec 17 12:57:59.229397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 950/1908] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:57:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:57:59.610544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:57:59.611174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:57:59.618150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:59.618599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:59.619378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:57:59.619808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:57:59.792298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:57:59.800965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dd5ac5f2-0fee-4438-977d-8981c1b4c4af tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.194210 Dec 17 12:57:59.801870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 959/1909] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:57:59 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:00.241829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-82438d91-c8ab-4056-bba8-5eb1a7b38399 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f6dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:00.292217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-82438d91-c8ab-4056-bba8-5eb1a7b38399 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054685 Dec 17 12:58:00.292950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 951/1910] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:00.822777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:00.823392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:00.832150 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:00.832713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:00.833948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:00.834537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:00.979005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:00.988223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ac336610-499c-429b-86e3-70548499e524 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169397 Dec 17 12:58:00.988817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 960/1911] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:00 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:01.306491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2d7be0cd-6021-4714-8c5b-073fcbeff2c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba114101f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:01.357590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2d7be0cd-6021-4714-8c5b-073fcbeff2c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055269 Dec 17 12:58:01.363111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 952/1912] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:02.007413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:02.008169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:02.014910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:02.015366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:02.016147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:02.016595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:02.157077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:02.166184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-21c23697-fd3a-4094-aa91-efea20c8de98 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164134 Dec 17 12:58:02.166783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 961/1913] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:02 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:02.371146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7017bb28-6e50-492a-901a-cb8b6b084bfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:02.427794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7017bb28-6e50-492a-901a-cb8b6b084bfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060632 Dec 17 12:58:02.428703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 953/1914] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:03.183470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:03.184090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:03.190503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:03.190955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:03.191794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:03.192221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:03.320341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:03.328641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ed905ab4-01d1-4f3e-8c3d-e70144db64ff tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.149102 Dec 17 12:58:03.329231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 962/1915] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:03 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:03.493220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5723a89b-6c61-465b-ae3f-76d8c5f7ba94 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:03.555576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5723a89b-6c61-465b-ae3f-76d8c5f7ba94 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.118622 Dec 17 12:58:03.556452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 954/1916] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:04.346313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:04.347558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:04.354612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:04.355051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:04.355847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:04.356276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:04.494372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:04.502342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b520cb54-43e6-41f8-b4ff-5d8da34cb646 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159788 Dec 17 12:58:04.502913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 963/1917] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:04 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:04.568371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4784d97c-aa69-456d-8859-84e52819d73c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:04.614222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4784d97c-aa69-456d-8859-84e52819d73c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049951 Dec 17 12:58:04.614809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 955/1918] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:05.518633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:05.519549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:05.526522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:05.526989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:05.527763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:05.528191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:05.627128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b9caf72-52e6-476a-a6b3-f57cb678ab4f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1163cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:05.670806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:05.675370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b9caf72-52e6-476a-a6b3-f57cb678ab4f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052266 Dec 17 12:58:05.675903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 956/1919] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:05.680110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1e15a518-7040-4f2f-956f-e7df82ae287f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165430 Dec 17 12:58:05.680848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 964/1920] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:05 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:06.687843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-72cbc8d1-a89c-41fe-84bd-895f9019b5d2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:06.699583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:06.700289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:06.709021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:06.709229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:06.710258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:06.710697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:06.740332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-72cbc8d1-a89c-41fe-84bd-895f9019b5d2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056708 Dec 17 12:58:06.741441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 957/1921] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:06.859054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:06.867530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6df6f53e-b657-4e8d-a0e3-28ce980a84e8 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.173012 Dec 17 12:58:06.868125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 965/1922] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:06 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:07.752588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8dc84b8e-09f6-4851-b344-aba843e6969e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:07.803480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8dc84b8e-09f6-4851-b344-aba843e6969e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055192 Dec 17 12:58:07.804217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 958/1923] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:07.884534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:07.885143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:07.891942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:07.892392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:07.893187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:07.893648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:08.034672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:08.042820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-61e40eb7-9ca6-4d2d-99f0-040a9475deab tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162063 Dec 17 12:58:08.043427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 966/1924] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:07 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:08.816453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb1a502b-0ab7-4869-9520-c03d412f9da3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e5e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:08.863443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb1a502b-0ab7-4869-9520-c03d412f9da3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051079 Dec 17 12:58:08.864173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 959/1925] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:09.060946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:09.061664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:09.071895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:09.072505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:09.073699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:09.074304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:09.206709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:09.215410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-299dd50a-60a1-4870-9605-60fe5ccc9130 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158380 Dec 17 12:58:09.215993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 967/1926] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:09 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:09.878812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd8bd908-7f83-4cef-8ed6-f7826573f5b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:09.929774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd8bd908-7f83-4cef-8ed6-f7826573f5b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057636 Dec 17 12:58:09.930346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 960/1927] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:10.232522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:10.233107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:10.239763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:10.240217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:10.240997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:10.241469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:10.378561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:10.389564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c3805815-f9a6-4982-a0b8-193df1b95f31 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.160658 Dec 17 12:58:10.390432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 968/1928] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:10 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:10.942898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-61f1fc01-46c0-4934-a899-174132782b6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f854c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:10.990339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-61f1fc01-46c0-4934-a899-174132782b6f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051583 Dec 17 12:58:10.990944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 961/1929] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:11.410745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:11.411676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:11.418362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:11.418802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:11.419558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:11.419997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:11.556586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:11.565264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-948d10e4-1905-46a3-86dc-97d70eeeb93d tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.158469 Dec 17 12:58:11.565869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 969/1930] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:11 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:12.003100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8424404f-bc69-4c3d-8c3b-42ae5cde84fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f65e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:12.055933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8424404f-bc69-4c3d-8c3b-42ae5cde84fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057011 Dec 17 12:58:12.056506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 962/1931] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:12.582918 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:12.583600 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:12.590564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:12.591003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:12.591767 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:12.592186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:12.724530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:12.733421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8901195e-b070-48c5-80e2-5ce3a74b1418 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.154340 Dec 17 12:58:12.734134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 970/1932] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:12 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:13.068532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-67d4837f-e66b-45ed-a12a-a98261f7341a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128fdc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:13.114928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-67d4837f-e66b-45ed-a12a-a98261f7341a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050675 Dec 17 12:58:13.115506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 963/1933] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:13.754363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:13.755718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:13.763262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:13.763702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:13.764538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:13.764960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:13.906861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:13.915956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c16d46c8-f055-49b7-a373-eefd9bb4edca tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.167795 Dec 17 12:58:13.916541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 971/1934] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:13 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:14.127920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ea25273b-8525-4014-8b7a-5541b4632727 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:14.175454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ea25273b-8525-4014-8b7a-5541b4632727 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051475 Dec 17 12:58:14.176140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 964/1935] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:14.936383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:14.936998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:14.944952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:14.945421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:14.946203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:14.946983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:15.095588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:15.104586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90ffc468-83e7-4be7-b910-8f5eda19635c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171911 Dec 17 12:58:15.106143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 972/1936] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:14 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:15.188538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4d6be0cb-94a6-43d9-8242-46f0767b3e67 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:15.236913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4d6be0cb-94a6-43d9-8242-46f0767b3e67 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052407 Dec 17 12:58:15.237685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 965/1937] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:16.122716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:16.123284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:16.130777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:16.131501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:16.133221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:16.134054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:16.250523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5206c207-1efc-4559-984a-15385e5bcab8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11634dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:16.271641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:16.280554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d0c10867-641a-4c71-ae01-83bfb3b64f56 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161708 Dec 17 12:58:16.281391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 973/1938] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:16 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:16.299499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5206c207-1efc-4559-984a-15385e5bcab8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053245 Dec 17 12:58:16.300062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 966/1939] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:17.297973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:17.298633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:17.305434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:17.305961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:17.306750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:17.307183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:17.311898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-03661e83-189c-440a-87ca-345820302b61 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:17.366350 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-03661e83-189c-440a-87ca-345820302b61 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058578 Dec 17 12:58:17.367104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 967/1940] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:17.455032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:17.464097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-667c8ee9-6756-40c6-8454-20852db2a1d5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169842 Dec 17 12:58:17.464635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 974/1941] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:17 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:18.379365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-725f4c5f-df89-4bc5-b0a2-3587a142e500 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:18.426126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-725f4c5f-df89-4bc5-b0a2-3587a142e500 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050928 Dec 17 12:58:18.426738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 968/1942] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:18.481192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:18.481795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:18.488852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:18.489294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:18.490347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:18.490739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:18.630009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:18.638971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a8502149-7f63-4bdc-b4e0-61dfdb8d1d83 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161985 Dec 17 12:58:18.639546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 975/1943] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:18 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:19.441077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a299828-b082-4070-8bb3-c1c9a5557ffa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:19.494894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a299828-b082-4070-8bb3-c1c9a5557ffa tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058935 Dec 17 12:58:19.495459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 969/1944] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:19.659396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:19.660349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:19.668071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:19.668691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:19.669625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:19.670050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:19.826538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:19.835778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e946e41a-35ba-463e-8595-14a0e7ef291a tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.182122 Dec 17 12:58:19.836052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 976/1945] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:19 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:20.508108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-956c4ea6-539a-4894-9065-b3bb2ace4d4e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cb80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:20.554662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-956c4ea6-539a-4894-9065-b3bb2ace4d4e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050702 Dec 17 12:58:20.559366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 970/1946] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:20.852524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:20.853118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:20.859810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:20.860216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:20.861191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:20.861647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:21.026607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:21.035528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6440368e-61fe-40c7-9cf9-4a2c4083cbbd tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.186865 Dec 17 12:58:21.036080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 977/1947] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:20 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:21.570385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-515c9dfe-8658-4d27-a2c1-53fcc0868cd1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:21.623081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-515c9dfe-8658-4d27-a2c1-53fcc0868cd1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059075 Dec 17 12:58:21.623626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 971/1948] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:22.054079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:22.054769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:22.062316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:22.062757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:22.063543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:22.063966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:22.209555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:22.219934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a3740f30-a2ae-4261-ba17-c4ba6dfd0379 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169868 Dec 17 12:58:22.220493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 978/1949] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:22 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:22.636171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-879d7c5d-e3af-4a4a-a605-7058e7e029e9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e31f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:22.695873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-879d7c5d-e3af-4a4a-a605-7058e7e029e9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063517 Dec 17 12:58:22.696818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 972/1950] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:23.237363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:23.237999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:23.246182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:23.246943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:23.247473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:23.247838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:23.391048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:23.399297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0ddfa883-857c-4257-b148-51c2987018e3 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.165702 Dec 17 12:58:23.400333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 979/1951] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:23 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:23.713252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-592346af-d249-48c9-b0b5-a10ab033c260 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126eee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:23.761876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-592346af-d249-48c9-b0b5-a10ab033c260 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053767 Dec 17 12:58:23.762521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 973/1952] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:24.416615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:24.417178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:24.424374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:24.424825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:24.425621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:24.426211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:24.585184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:24.594680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d33335cd-3c2c-4356-beb8-5a7babaf6a28 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.182299 Dec 17 12:58:24.595259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 980/1953] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:24 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:24.777951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8e431809-809c-4b6e-9d72-8267993365ae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:24.827620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8e431809-809c-4b6e-9d72-8267993365ae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055948 Dec 17 12:58:24.828205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 974/1954] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:25.612756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:25.613539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:25.620604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:25.621017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:25.621872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:25.622276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:25.778679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:25.786939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-88896314-dd78-476f-b270-6b3ce1990116 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178021 Dec 17 12:58:25.787850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 981/1955] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:25 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:25.841625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1daabd7-e015-46a6-88f4-e51071c1fb60 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112725e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:25.888646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1daabd7-e015-46a6-88f4-e51071c1fb60 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051672 Dec 17 12:58:25.889226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 975/1956] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:26.804598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:26.805467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:26.812881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:26.813351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:26.814397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:26.814891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:26.901689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eea3a16c-3499-4d8c-b21b-e3e20ed6bee7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:26.951946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eea3a16c-3499-4d8c-b21b-e3e20ed6bee7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054296 Dec 17 12:58:26.952487 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 976/1957] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:26.962389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:26.969592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-589e2f2c-656c-490a-819a-75e0080f86b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.168996 Dec 17 12:58:26.970300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 982/1958] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:26 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:27.967030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a3dab21e-13ec-4707-a6e7-27fe7be37be3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:27.988344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:27.989144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:27.995788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:27.996231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:27.997000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:27.997464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:28.020650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a3dab21e-13ec-4707-a6e7-27fe7be37be3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058244 Dec 17 12:58:28.021233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 977/1959] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:28.146777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:28.155612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-455295a4-fb94-4706-b143-b8c3ecf7d5bf tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172874 Dec 17 12:58:28.156186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 983/1960] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:27 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:29.035348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cb570608-9a05-4008-9cea-890a2e3829b8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:29.089702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cb570608-9a05-4008-9cea-890a2e3829b8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058419 Dec 17 12:58:29.090298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 978/1961] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:29.174382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:29.175096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:29.182005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:29.182468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:29.183251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:29.183678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:29.322591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:29.331346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a8457428-3706-4e8b-9d7d-1518f7c9db17 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161628 Dec 17 12:58:29.331848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 984/1962] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:29 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:30.103954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-19e69101-f069-4955-b9d1-c964f191197c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba113843a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:30.151964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-19e69101-f069-4955-b9d1-c964f191197c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053020 Dec 17 12:58:30.152543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 979/1963] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:30.348974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:30.349722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:30.356835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:30.357195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:30.358032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:30.358473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:30.500948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:30.509380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-12bf0296-6d67-4123-8bef-5f423fbcc604 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.164110 Dec 17 12:58:30.510111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 985/1964] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:30 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:30.549250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:58:30.549539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 12:58:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:58:31.164749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2de2db9f-4e6e-424c-a1ba-8aaaa1fd5a28 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:31.211843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2de2db9f-4e6e-424c-a1ba-8aaaa1fd5a28 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051226 Dec 17 12:58:31.212422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 980/1965] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:31.526747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:31.527307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:31.534050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:31.534498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:31.535290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:31.535729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:31.676563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:31.684812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-483dc6ed-b82c-4c34-a00c-3fa4021ee9c7 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162143 Dec 17 12:58:31.685412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 986/1966] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:31 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:32.226029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-935b06e8-452a-4c69-912b-0df7564536b2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:32.279818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-935b06e8-452a-4c69-912b-0df7564536b2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059541 Dec 17 12:58:32.280422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 981/1967] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:32.706881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:32.707527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:32.716256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:32.716756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:32.717679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:32.718220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:32.867219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:32.876529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1caca5e5-9cbb-4959-8c10-79d8aa790720 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.175853 Dec 17 12:58:32.877131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 987/1968] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:32 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:33.294190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a7503725-6766-4524-8542-e965bb16e718 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ea60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:33.340589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a7503725-6766-4524-8542-e965bb16e718 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051190 Dec 17 12:58:33.341152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 982/1969] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:33.897049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:33.897731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:33.905494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:33.905935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:33.906726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:33.907155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:34.051523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:34.062671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e22ca94d-7db0-45ba-b0f3-39655c28496f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.171570 Dec 17 12:58:34.063397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 988/1970] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:33 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:34.357019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99564b01-3123-4cde-9c06-c1b460ba4f1b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:34.415243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99564b01-3123-4cde-9c06-c1b460ba4f1b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062694 Dec 17 12:58:34.415829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 983/1971] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:35.082028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:35.082586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:35.089646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:35.090098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:35.090884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:35.091376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:35.242396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:35.250702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4dd1444-1c09-42b1-bdef-8f98f3ee71fe tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.172427 Dec 17 12:58:35.251279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 989/1972] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:35 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:35.428464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0fe1212c-c955-44ab-9e87-e823c5c913ed tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ee50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:35.475385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0fe1212c-c955-44ab-9e87-e823c5c913ed tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051237 Dec 17 12:58:35.475944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 984/1973] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:36.267353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:36.267978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:36.274700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:36.275149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:36.275945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:36.276372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:36.418129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:36.426450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44528280-b67f-4bbc-a67e-c9efa09cfcd0 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162771 Dec 17 12:58:36.427089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 990/1974] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:36 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:36.489196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7230d4df-b2f6-4f36-932e-7d50c9b749c0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112720d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:36.535479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7230d4df-b2f6-4f36-932e-7d50c9b749c0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050885 Dec 17 12:58:36.536337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 985/1975] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:37.448502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:37.449117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:37.455938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:37.456394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:37.457186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:37.457652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:37.548815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce300ad8-7733-4d61-824f-daf582693f7f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:37.597995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:37.600079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce300ad8-7733-4d61-824f-daf582693f7f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055411 Dec 17 12:58:37.600625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 986/1976] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:37.605925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c279ca2d-7ec4-4f45-b5ae-a72113f8de78 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.161363 Dec 17 12:58:37.606478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 991/1977] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:37 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:38.617201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0eef0936-ec07-49b6-ad41-69018ad00efe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:38.626406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:38.627294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:38.637953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:38.638696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:38.640070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:38.640499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:38.670810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0eef0936-ec07-49b6-ad41-69018ad00efe tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060461 Dec 17 12:58:38.675563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 987/1978] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 12:58:38.771007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:38.779914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2397bd5a-61b5-4654-aae5-d06e950413d9 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.159814 Dec 17 12:58:38.780535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 992/1979] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:38 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:39.686787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5f3836d0-beaf-4ae8-8981-99a30b10fada tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:39.734041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5f3836d0-beaf-4ae8-8981-99a30b10fada tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053307 Dec 17 12:58:39.734610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 988/1980] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:39.796758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:39.797358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:39.804144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:39.804590 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:39.805378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:39.805814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:40.188189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:40.196384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3df59a43-f395-423e-87bc-8b2f676cc57f tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.403378 Dec 17 12:58:40.196961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 993/1981] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:39 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:40.750248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ea73c20e-eb02-4beb-bc52-786a649c3248 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:40.808808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ea73c20e-eb02-4beb-bc52-786a649c3248 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065388 Dec 17 12:58:40.809409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 989/1982] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:41.214009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:41.214606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:41.221374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:41.221803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:41.222574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:41.223001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:41.356904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:41.366253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ffb0b012-632c-436f-8c32-c3674a1c3271 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.155986 Dec 17 12:58:41.367175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 994/1983] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:41 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:41.826259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-44cdbe0e-80c3-4643-9047-d5a0d2cb2e51 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:41.873164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-44cdbe0e-80c3-4643-9047-d5a0d2cb2e51 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053617 Dec 17 12:58:41.873834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 990/1984] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:42.383664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:42.384290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:42.390781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:42.391223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:42.391988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:42.392416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:42.524800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:42.533130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8759b9fd-98d7-4bd9-9f45-6d12f223550b tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.153214 Dec 17 12:58:42.533752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 995/1985] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:42 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:42.886866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e658e63d-9498-4a43-ab14-2f1d5dfd8462 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:42.934414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e658e63d-9498-4a43-ab14-2f1d5dfd8462 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051719 Dec 17 12:58:42.934984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 991/1986] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:43.553656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:43.554232 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:43.563010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:43.563661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:43.564675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:43.565107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:43.706865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:43.718062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68c24312-69b5-4e24-8dab-193da44221b5 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.170197 Dec 17 12:58:43.718716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 996/1987] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:43 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:43.950040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da6abfc6-b1bc-4316-804c-ee3ab6f96992 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315d30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:43.998135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da6abfc6-b1bc-4316-804c-ee3ab6f96992 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052359 Dec 17 12:58:43.998701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 992/1988] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:44.735428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:44.736093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:44.746437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:44.746886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:44.747680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:44.748108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:44.901905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:44.910209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-addb1c71-d234-4bfe-8036-91f5bbb1f131 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.178566 Dec 17 12:58:44.910861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 997/1989] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:44 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:45.011846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e8ba4a1d-afc9-408e-a04d-dcbaf527ef08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:45.065972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e8ba4a1d-afc9-408e-a04d-dcbaf527ef08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058668 Dec 17 12:58:45.066552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 993/1990] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:45.927532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:45.928141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:45.936041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:45.936681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:45.937903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:45.938455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:46.079504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-049af3ec-73e3-4855-afef-1a6738530400 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:46.084661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:46.093311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ee3c5abb-83cf-4091-aa97-dfab7f47dd2c tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.169494 Dec 17 12:58:46.093962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 998/1991] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:45 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:46.127083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-049af3ec-73e3-4855-afef-1a6738530400 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051874 Dec 17 12:58:46.127651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 994/1992] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:47.114373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:47.114960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] [instance: 3e1ede74-0deb-4b88-af72-a692da9b71ed] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 12:58:47.123455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:47.124063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:47.124858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 12:58:47.125318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 12:58:47.139892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b050805-66aa-4f21-bdc9-b9f69148edae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:47.189271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b050805-66aa-4f21-bdc9-b9f69148edae tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053498 Dec 17 12:58:47.189884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 995/1993] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:47.260421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547f32803db45e2b0f1291d8abd7669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8722c81a36bb4493b0aa4c34f7ba146d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 12:58:47.270822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fc66103f-43d3-4232-9856-29bc1011fb12 tempest-VolumesSnapshotTestJSON-625723910 tempest-VolumesSnapshotTestJSON-625723910-project] 10.222.0.45 "GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed" status: 200 len: 1560 microversion: 2.1 time: 0.162200 Dec 17 12:58:47.271501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 999/1994] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 12:58:47 2021] GET /compute/v2.1/servers/3e1ede74-0deb-4b88-af72-a692da9b71ed => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 12:58:48.208187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4caae52c-f212-4608-ac82-95f8fc246f79 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ec10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:48.258237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4caae52c-f212-4608-ac82-95f8fc246f79 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058536 Dec 17 12:58:48.258811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 996/1995] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:49.274708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eed12a6a-3fd2-43c9-8003-c096cbe78f38 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:49.323050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eed12a6a-3fd2-43c9-8003-c096cbe78f38 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054713 Dec 17 12:58:49.323626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1000/1996] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:50.336407 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16995703-b17a-4b42-9bcc-5073ec918703 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:50.382155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16995703-b17a-4b42-9bcc-5073ec918703 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050360 Dec 17 12:58:50.382758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 997/1997] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:51.395772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f7c9d311-97c8-4685-84f5-6e3fdf9cbeb6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d7e280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:51.445536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f7c9d311-97c8-4685-84f5-6e3fdf9cbeb6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053876 Dec 17 12:58:51.446096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1001/1998] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:52.460520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52a3d541-6648-4320-9b9c-73b6a280ee64 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b84c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:52.507401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52a3d541-6648-4320-9b9c-73b6a280ee64 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051517 Dec 17 12:58:52.507976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 998/1999] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:52.870803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 12:58:52.871431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 12:58:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 12:58:53.520332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8ed6380-c565-413d-b56e-3b80ee42a5d4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122f940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:53.568524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8ed6380-c565-413d-b56e-3b80ee42a5d4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052207 Dec 17 12:58:53.569255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1002/2000] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:54.580681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8b4c8884-e4a9-4449-9b43-edced0ac569c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128fdc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:54.628223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8b4c8884-e4a9-4449-9b43-edced0ac569c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051737 Dec 17 12:58:54.628768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 999/2001] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:55.641927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-884490b0-8d0f-4c71-aae2-cf87824ca853 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d70160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:55.691574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-884490b0-8d0f-4c71-aae2-cf87824ca853 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054353 Dec 17 12:58:55.692166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1003/2002] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:56.704652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8fdb3a0d-8882-456a-9f59-a8021c7d0da2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:56.754839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8fdb3a0d-8882-456a-9f59-a8021c7d0da2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054502 Dec 17 12:58:56.755432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1000/2003] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:57.767530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de708156-a67b-4be4-be78-ba369e69ec27 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f94c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:57.814203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de708156-a67b-4be4-be78-ba369e69ec27 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051240 Dec 17 12:58:57.814825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1004/2004] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:58.830403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-88aefdb3-a0fc-4e22-a8c8-706508a2b148 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cb80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:58.887678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-88aefdb3-a0fc-4e22-a8c8-706508a2b148 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062323 Dec 17 12:58:58.888544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1001/2005] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:58:59.900485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c363c868-93b9-4cc0-8fce-7b7c3a456004 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e6e4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:58:59.947879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c363c868-93b9-4cc0-8fce-7b7c3a456004 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051507 Dec 17 12:58:59.948449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1005/2006] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:58:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:00.961512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f8f2088a-4f88-455b-a019-a2ab5bfdbd6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:01.008905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f8f2088a-4f88-455b-a019-a2ab5bfdbd6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052025 Dec 17 12:59:01.009508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1002/2007] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:02.026005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8d5b9914-8859-4a02-9c60-08c14a3e9ca4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:02.079651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8d5b9914-8859-4a02-9c60-08c14a3e9ca4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060425 Dec 17 12:59:02.080298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1006/2008] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:03.092491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-db786968-6747-49ec-ae5a-62407e868297 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128fe50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:03.138354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-db786968-6747-49ec-ae5a-62407e868297 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049992 Dec 17 12:59:03.138925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1003/2009] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:03.191555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ea7ff7c-356a-48f9-a3d5-12b6638c39e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:03.241910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-3ea7ff7c-356a-48f9-a3d5-12b6638c39e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-907e94d1-195a-43b1-8e84-6a8aa40de2af) Dec 17 12:59:03.242492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ea7ff7c-356a-48f9-a3d5-12b6638c39e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-907e94d1-195a-43b1-8e84-6a8aa40de2af) {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 12:59:03.243353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3ea7ff7c-356a-48f9-a3d5-12b6638c39e7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 400 len: 375 microversion: 2.1 time: 0.055409 Dec 17 12:59:03.243899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1007/2010] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Dec 17 12:59:03 2021] DELETE /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 375 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 17 12:59:03.251709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb6c3983-a948-4d20-bc7d-c6c897b0c7dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129db80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:03.298179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fb6c3983-a948-4d20-bc7d-c6c897b0c7dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049965 Dec 17 12:59:03.298758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1004/2011] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:04.310830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b03ca487-683c-4d97-a3b2-9dd9090b1fef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112038b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:04.356174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b03ca487-683c-4d97-a3b2-9dd9090b1fef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049427 Dec 17 12:59:04.356740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1008/2012] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:05.368997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a79694c-6f4e-466b-b8ab-6ad23bb093b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:05.415286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a79694c-6f4e-466b-b8ab-6ad23bb093b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050345 Dec 17 12:59:05.415854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1005/2013] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:06.428830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a658d533-180d-4e5c-8da8-ac07bcb2d757 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d708b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:06.479583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a658d533-180d-4e5c-8da8-ac07bcb2d757 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055124 Dec 17 12:59:06.480465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1009/2014] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:07.492997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aed6be5c-2023-4976-8fa2-7ddacd8a00bd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:07.540015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aed6be5c-2023-4976-8fa2-7ddacd8a00bd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051152 Dec 17 12:59:07.540720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1006/2015] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:08.552529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-00c0f15f-c558-455f-93a3-b4896ae15001 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:08.605841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-00c0f15f-c558-455f-93a3-b4896ae15001 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057395 Dec 17 12:59:08.606413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1010/2016] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:09.622922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9793f47c-b932-4b3e-a9ed-680b142a9656 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:09.670028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9793f47c-b932-4b3e-a9ed-680b142a9656 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053934 Dec 17 12:59:09.670721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1007/2017] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:10.683076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-764ba7ba-8ed2-4ca5-a203-f788e287b725 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:10.731034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-764ba7ba-8ed2-4ca5-a203-f788e287b725 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052043 Dec 17 12:59:10.731609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1011/2018] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:11.747898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f6671de4-084e-41c9-bce7-4fe8fba6b0b3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11634280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:11.795634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f6671de4-084e-41c9-bce7-4fe8fba6b0b3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054575 Dec 17 12:59:11.796194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1008/2019] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:12.808556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a15239ec-9379-4cbd-ba91-959f435d3565 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122c3a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:12.855901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a15239ec-9379-4cbd-ba91-959f435d3565 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051381 Dec 17 12:59:12.856470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1012/2020] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:13.868492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dac0d323-80a8-4c65-8ee3-7224ed075ff4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129ddc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:13.922093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dac0d323-80a8-4c65-8ee3-7224ed075ff4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057651 Dec 17 12:59:13.922675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1009/2021] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:14.937611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-16f812e9-405f-47cf-bfaf-5d6a3221b514 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:14.992668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-16f812e9-405f-47cf-bfaf-5d6a3221b514 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061369 Dec 17 12:59:14.993441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1013/2022] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:16.006440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a433820a-2016-47a1-9633-724f8ced3e5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162613a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:16.054285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a433820a-2016-47a1-9633-724f8ced3e5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052009 Dec 17 12:59:16.054900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1010/2023] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:17.067827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a2610787-1df8-41c2-97e6-a0cd40284a25 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:17.114783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a2610787-1df8-41c2-97e6-a0cd40284a25 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051157 Dec 17 12:59:17.115362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1014/2024] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:18.131026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fea9da46-2b2f-411c-86e6-09581496883a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129d8b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:18.187158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fea9da46-2b2f-411c-86e6-09581496883a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062275 Dec 17 12:59:18.188057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1011/2025] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:19.204044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de093f47-70a7-42d1-a959-8d3f3d770b40 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:19.251180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de093f47-70a7-42d1-a959-8d3f3d770b40 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052632 Dec 17 12:59:19.251756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1015/2026] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:20.264392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2e3aaed1-3369-4018-87e5-854ea53d9065 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:20.313270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2e3aaed1-3369-4018-87e5-854ea53d9065 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053199 Dec 17 12:59:20.313873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1012/2027] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:21.327174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0fea0a69-8b05-464a-b375-7bae3331f6ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d84af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:21.384756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0fea0a69-8b05-464a-b375-7bae3331f6ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061725 Dec 17 12:59:21.385714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1016/2028] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:22.397490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b1b95aa9-95d6-4903-a13d-80d6dd69ab3e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162611f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:22.447505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b1b95aa9-95d6-4903-a13d-80d6dd69ab3e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054218 Dec 17 12:59:22.448080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1013/2029] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:23.460791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dc4dcf40-8086-4d96-aa2c-355c147922c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111eeca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:23.511228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dc4dcf40-8086-4d96-aa2c-355c147922c3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054950 Dec 17 12:59:23.511865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1017/2030] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:24.526475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ecc1f704-5e54-479e-bcb5-8ae9a0723909 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:24.573459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ecc1f704-5e54-479e-bcb5-8ae9a0723909 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053311 Dec 17 12:59:24.574007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1014/2031] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:25.587444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30d5d152-03ff-4930-b650-c13bd8b50fc1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111b85e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:25.642148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30d5d152-03ff-4930-b650-c13bd8b50fc1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059157 Dec 17 12:59:25.642742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1018/2032] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:26.655143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a08c281b-8463-408a-b117-1772b01f3462 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129dc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:26.702208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a08c281b-8463-408a-b117-1772b01f3462 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051260 Dec 17 12:59:26.702777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1015/2033] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:27.715428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-72b45dd6-804d-453b-a524-04695930f8f2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111eea60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:27.762117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-72b45dd6-804d-453b-a524-04695930f8f2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050827 Dec 17 12:59:27.762693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1019/2034] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:28.777689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1d0a74d9-623b-462c-8eaa-2ba0e884e4b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:28.831395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1d0a74d9-623b-462c-8eaa-2ba0e884e4b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059715 Dec 17 12:59:28.831994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1016/2035] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:29.844659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-10c857fb-245d-435b-8fe9-3a928c19e175 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:29.891765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-10c857fb-245d-435b-8fe9-3a928c19e175 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051218 Dec 17 12:59:29.892335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1020/2036] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:30.904928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38013574-dea3-415c-bf6b-e642a3eb05e8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:30.951545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38013574-dea3-415c-bf6b-e642a3eb05e8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050804 Dec 17 12:59:30.952120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1017/2037] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:31.965012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11062328-61b7-4c7e-9af0-6648f47da5f8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111b8820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:32.012815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11062328-61b7-4c7e-9af0-6648f47da5f8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051981 Dec 17 12:59:32.013535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1021/2038] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:33.026058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20d8bf64-60d4-4370-a3a7-5f6758b2979d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:33.074385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20d8bf64-60d4-4370-a3a7-5f6758b2979d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052395 Dec 17 12:59:33.074947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1018/2039] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:34.088097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-176ec28e-1adf-4cbf-acf9-148155d08a89 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:34.141406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-176ec28e-1adf-4cbf-acf9-148155d08a89 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057699 Dec 17 12:59:34.141984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1022/2040] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:35.154510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66ed2447-2ab3-4247-a24d-da2f2c2719b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162633a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:35.205718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66ed2447-2ab3-4247-a24d-da2f2c2719b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055293 Dec 17 12:59:35.206304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1019/2041] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:36.220656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b245b7ea-440c-4426-87d0-3c060ef60e94 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e404c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:36.273888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b245b7ea-440c-4426-87d0-3c060ef60e94 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057406 Dec 17 12:59:36.274458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1023/2042] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:37.289993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8b5d5eed-5cac-41a9-9623-84212269735a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:37.340433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8b5d5eed-5cac-41a9-9623-84212269735a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056262 Dec 17 12:59:37.340999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1020/2043] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:38.354876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5615d0b7-82b8-4a3a-84a9-e54fcaf9b41f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c95e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:38.406728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5615d0b7-82b8-4a3a-84a9-e54fcaf9b41f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057431 Dec 17 12:59:38.407526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1024/2044] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:39.419545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55f6aa25-a6ba-41a7-b9c1-4db0858dfd70 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:39.473922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55f6aa25-a6ba-41a7-b9c1-4db0858dfd70 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058468 Dec 17 12:59:39.474469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1021/2045] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:40.486289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8591818e-8c8d-4163-8c10-d97178f868b1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e40310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:40.534073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8591818e-8c8d-4163-8c10-d97178f868b1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052013 Dec 17 12:59:40.534666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1025/2046] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:41.547389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9bab5527-535d-4c1b-ab65-25d18db9460a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba114101f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:41.596884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9bab5527-535d-4c1b-ab65-25d18db9460a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053732 Dec 17 12:59:41.597556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1022/2047] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:42.611682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d114146e-cf33-4742-a8e0-b68bf5140fa3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120cb80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:42.669262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d114146e-cf33-4742-a8e0-b68bf5140fa3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061666 Dec 17 12:59:42.669877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1026/2048] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:43.683666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3d90b949-3e05-4ab9-aea4-a9f091935868 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:43.731977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3d90b949-3e05-4ab9-aea4-a9f091935868 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052566 Dec 17 12:59:43.732547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1023/2049] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:44.749461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4b53d5ae-a2ae-4ceb-b2ea-a5ae31b4b875 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9790>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:44.802994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4b53d5ae-a2ae-4ceb-b2ea-a5ae31b4b875 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059917 Dec 17 12:59:44.803563 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1027/2050] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:45.817199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-10aa37e6-15e9-4e29-a600-1a1f8824a712 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162619d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:45.875958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-10aa37e6-15e9-4e29-a600-1a1f8824a712 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063553 Dec 17 12:59:45.876550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1024/2051] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:46.890350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0c006d5e-d73d-487d-937b-b4e420faec6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11db09d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:46.953803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0c006d5e-d73d-487d-937b-b4e420faec6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.069097 Dec 17 12:59:46.954407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1028/2052] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:47.969517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a651361-df17-44f7-a9a4-88ef9702edce tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:48.021007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a651361-df17-44f7-a9a4-88ef9702edce tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056365 Dec 17 12:59:48.021639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1025/2053] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:49.034212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a0aa3ae4-9930-4cdc-a7cd-c5c20f2adee8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:49.086884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a0aa3ae4-9930-4cdc-a7cd-c5c20f2adee8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056745 Dec 17 12:59:49.087448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1029/2054] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:50.100313 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a679d4e0-e75e-402e-9e48-38f10332d804 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:50.147966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a679d4e0-e75e-402e-9e48-38f10332d804 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051902 Dec 17 12:59:50.148534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1026/2055] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:51.160915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba5ad791-2d03-4b1d-8bf2-d1312d795e37 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111be4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:51.211987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba5ad791-2d03-4b1d-8bf2-d1312d795e37 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054949 Dec 17 12:59:51.212622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1030/2056] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:52.225268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c7d83546-7f98-420f-8cf9-8345cc243b21 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:52.276338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c7d83546-7f98-420f-8cf9-8345cc243b21 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055044 Dec 17 12:59:52.277082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1027/2057] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:53.290248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8843264e-3e14-495f-b5c2-541813b32bf8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:53.342583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8843264e-3e14-495f-b5c2-541813b32bf8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056397 Dec 17 12:59:53.343154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1031/2058] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:54.356965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-571b677f-f316-469b-8ae2-b78352bf0c5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:54.407131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-571b677f-f316-469b-8ae2-b78352bf0c5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054572 Dec 17 12:59:54.407695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1028/2059] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:55.420558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-81cf4dbf-fb4a-4d6a-a17b-821881f3385f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:55.467223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-81cf4dbf-fb4a-4d6a-a17b-821881f3385f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050877 Dec 17 12:59:55.467783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1032/2060] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:56.480847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ea718131-8cf7-49d4-9f9b-c4341505ff6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e35e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:56.527965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ea718131-8cf7-49d4-9f9b-c4341505ff6c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051313 Dec 17 12:59:56.528643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1029/2061] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:57.542988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0d7c0660-5686-421e-bd39-8c4d30e73d99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122cc10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:57.595593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0d7c0660-5686-421e-bd39-8c4d30e73d99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058445 Dec 17 12:59:57.596157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1033/2062] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:58.610550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4168918e-d01c-4265-89b3-0b24adccd735 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1136b1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:58.659514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4168918e-d01c-4265-89b3-0b24adccd735 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053117 Dec 17 12:59:58.660116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1030/2063] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 12:59:59.672589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fbc9788f-4711-4f08-bd00-a1b6971c6b36 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 12:59:59.720230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fbc9788f-4711-4f08-bd00-a1b6971c6b36 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051835 Dec 17 12:59:59.720817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1034/2064] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 12:59:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:00.733103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c5978409-0dbb-4bc6-8e57-bab232930468 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b6670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:00.782792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c5978409-0dbb-4bc6-8e57-bab232930468 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053848 Dec 17 13:00:00.783324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1031/2065] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:01.795729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e755c70d-8578-46e2-bf85-f10bc9e8641d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9e50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:01.852809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e755c70d-8578-46e2-bf85-f10bc9e8641d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061357 Dec 17 13:00:01.853465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1035/2066] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:02.866200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3051271c-813d-47c2-b308-a355644c49a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:02.915384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3051271c-813d-47c2-b308-a355644c49a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053720 Dec 17 13:00:02.915952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1032/2067] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:03.929617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66ad383c-e853-4298-8fdd-6b2fcdcd2c28 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a09d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:03.980829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66ad383c-e853-4298-8fdd-6b2fcdcd2c28 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055978 Dec 17 13:00:03.981449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1036/2068] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:04.214675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:00:04.214975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:00:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:00:04.993834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-19c9a36b-ad91-4aae-b5d0-5b5e7ae4a5b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162611f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:05.047018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-19c9a36b-ad91-4aae-b5d0-5b5e7ae4a5b4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057091 Dec 17 13:00:05.047688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1033/2069] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:05.892219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:00:05.892462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:00:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:00:06.063468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fc209979-1f1a-4070-acb4-1b2c33a8ea7d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c94c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:06.120354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fc209979-1f1a-4070-acb4-1b2c33a8ea7d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063565 Dec 17 13:00:06.120926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1037/2070] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:07.133831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0185faf3-661a-409a-8ae6-17b96a8fa03b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:07.179477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0185faf3-661a-409a-8ae6-17b96a8fa03b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050247 Dec 17 13:00:07.180055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1034/2071] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:08.192356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7835c7d6-03bd-4e42-a268-4001c356ef5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:08.241310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7835c7d6-03bd-4e42-a268-4001c356ef5f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053033 Dec 17 13:00:08.242023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1038/2072] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:09.255636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-80c98864-5822-4f1f-83f3-a89c4a213e66 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:09.307709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-80c98864-5822-4f1f-83f3-a89c4a213e66 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057608 Dec 17 13:00:09.308339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1035/2073] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:09.377822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:00:09.378346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:00:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:00:10.321333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-35c27468-2dbe-4644-b5a7-9f8abe87c221 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c90d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:10.370333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-35c27468-2dbe-4644-b5a7-9f8abe87c221 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053199 Dec 17 13:00:10.371215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1039/2074] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:11.384380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7ea1635f-7ece-42c0-ac90-034d9554c240 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:11.435121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7ea1635f-7ece-42c0-ac90-034d9554c240 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054945 Dec 17 13:00:11.435694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1036/2075] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:12.448110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e1d841a5-c207-4dac-bdb0-f02665bd81cb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122cdc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:12.503715 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e1d841a5-c207-4dac-bdb0-f02665bd81cb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059664 Dec 17 13:00:12.504406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1040/2076] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:13.519036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-90d9587e-31e6-412c-887a-5da7cb92e5c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:13.567311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-90d9587e-31e6-412c-887a-5da7cb92e5c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052406 Dec 17 13:00:13.567884 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1037/2077] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:14.579353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92e1b0ff-9468-4b8c-8cbd-f38a0a649450 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:14.627559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92e1b0ff-9468-4b8c-8cbd-f38a0a649450 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052353 Dec 17 13:00:14.628131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1041/2078] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:15.642368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-576448be-73c6-4c3a-8f3e-b6d0495f486f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:15.693091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-576448be-73c6-4c3a-8f3e-b6d0495f486f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054253 Dec 17 13:00:15.693091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1038/2079] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:16.710445 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2cf89378-882b-401f-b4be-227d4792e37b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:16.758877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2cf89378-882b-401f-b4be-227d4792e37b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055396 Dec 17 13:00:16.759439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1042/2080] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:17.772425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d1a4b5bd-5c01-4d28-adc3-6304267913d9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162619d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:17.823976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d1a4b5bd-5c01-4d28-adc3-6304267913d9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056294 Dec 17 13:00:17.824765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1039/2081] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:18.837932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e0c5d93d-425b-4cf0-a8ea-342471b39e5b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:18.869227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:00:18.869791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:00:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:00:18.886375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e0c5d93d-425b-4cf0-a8ea-342471b39e5b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052940 Dec 17 13:00:18.887004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1043/2082] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:19.900201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-42c0a68d-228b-48c5-91d1-bbd53a825ac7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:19.947712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-42c0a68d-228b-48c5-91d1-bbd53a825ac7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052277 Dec 17 13:00:19.948406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1040/2083] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:20.962205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-334875ad-8aa4-4e46-8135-6c5b1d3f9429 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11cbfee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:21.014950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-334875ad-8aa4-4e46-8135-6c5b1d3f9429 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058492 Dec 17 13:00:21.015526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1044/2084] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:22.027883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e07c33d2-86e4-4a2c-87ef-35be77da5842 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:22.085342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e07c33d2-86e4-4a2c-87ef-35be77da5842 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061424 Dec 17 13:00:22.086136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1041/2085] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:23.098377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90dc64b6-350e-4db5-a6ad-73eb7ba9b4c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:23.148939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90dc64b6-350e-4db5-a6ad-73eb7ba9b4c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054731 Dec 17 13:00:23.149546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1045/2086] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:24.162897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e4e38343-5a64-4194-ba46-552f49615063 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315d30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:24.217955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e4e38343-5a64-4194-ba46-552f49615063 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060008 Dec 17 13:00:24.218513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1042/2087] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:25.233345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-425b0aa7-9063-4a85-b16b-7c1bcc877949 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122fca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:25.281661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-425b0aa7-9063-4a85-b16b-7c1bcc877949 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053687 Dec 17 13:00:25.282531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1046/2088] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:26.294741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9643e894-af55-4e46-acb7-cbda6d740e73 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112761f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:26.343433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9643e894-af55-4e46-acb7-cbda6d740e73 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052893 Dec 17 13:00:26.344123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1043/2089] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:27.356495 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d858f96b-c5bb-4e3d-91c4-36fac10d8396 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c98b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:27.413000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d858f96b-c5bb-4e3d-91c4-36fac10d8396 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060577 Dec 17 13:00:27.413613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1047/2090] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:28.426444 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18d93b24-8f79-451b-96f7-3ab2a3b83326 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1136b820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:28.473667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-18d93b24-8f79-451b-96f7-3ab2a3b83326 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051269 Dec 17 13:00:28.474232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1044/2091] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:29.486633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-96096835-00e3-4236-8d0e-508146b4a640 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f94c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:29.537207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-96096835-00e3-4236-8d0e-508146b4a640 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054802 Dec 17 13:00:29.537830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1048/2092] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:30.549761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-33eb3d8f-9187-4f8a-b93a-452a8f621990 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:30.602327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-33eb3d8f-9187-4f8a-b93a-452a8f621990 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056406 Dec 17 13:00:30.607206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1045/2093] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:31.615691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-922b714c-0d37-4863-beb6-f48cf2d5b864 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:31.667148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-922b714c-0d37-4863-beb6-f48cf2d5b864 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055621 Dec 17 13:00:31.667907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1049/2094] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:32.683810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e918e2a-3552-4b03-883a-bade4b1ba997 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:32.738158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e918e2a-3552-4b03-883a-bade4b1ba997 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061034 Dec 17 13:00:32.738742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1046/2095] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:33.751030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-323146b3-b145-404e-b84e-61fcdccb9cea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203dc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:33.807733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-323146b3-b145-404e-b84e-61fcdccb9cea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060956 Dec 17 13:00:33.808274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1050/2096] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:34.821443 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d22c4231-c71b-4e06-82cb-c30583d5e4fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:34.869397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d22c4231-c71b-4e06-82cb-c30583d5e4fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052623 Dec 17 13:00:34.869971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1047/2097] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:35.885679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1ac49a5e-772a-4b77-a1be-2c855c38a3dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122cca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:35.935838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1ac49a5e-772a-4b77-a1be-2c855c38a3dc tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054304 Dec 17 13:00:35.936446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1051/2098] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:36.951010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f71b5087-ab86-42c4-9810-7d16bda933c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:36.999759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f71b5087-ab86-42c4-9810-7d16bda933c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053743 Dec 17 13:00:37.000702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1048/2099] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:38.015651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-551610ae-7b57-43ab-b130-23175546c9dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d84a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:38.066756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-551610ae-7b57-43ab-b130-23175546c9dd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056451 Dec 17 13:00:38.067304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1052/2100] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:39.080628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1cac15b7-9931-4f35-81e5-34387cab2ccd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16266160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:39.133704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1cac15b7-9931-4f35-81e5-34387cab2ccd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058050 Dec 17 13:00:39.134274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1049/2101] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:40.147858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-87b5c43b-d457-4f47-ac1b-5a6887c08b64 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:40.197972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-87b5c43b-d457-4f47-ac1b-5a6887c08b64 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054300 Dec 17 13:00:40.198603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1053/2102] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:41.211216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-384808de-6182-41af-9e1d-2927aa721b9a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11f85670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:41.264544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-384808de-6182-41af-9e1d-2927aa721b9a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057791 Dec 17 13:00:41.265114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1050/2103] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:42.278602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f7a59053-7720-4cbb-9c4e-d512fd432156 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3bc10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:42.324599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f7a59053-7720-4cbb-9c4e-d512fd432156 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050133 Dec 17 13:00:42.325216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1054/2104] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:43.337975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16fab90d-6aac-49b1-9bca-1aa4a967136f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:43.394065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16fab90d-6aac-49b1-9bca-1aa4a967136f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061073 Dec 17 13:00:43.394703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1051/2105] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:44.407251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e49f732-02e4-4068-a91d-ae177c8b52b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cd430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:44.456390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e49f732-02e4-4068-a91d-ae177c8b52b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053487 Dec 17 13:00:44.456969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1055/2106] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:45.469694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0672f448-ab8b-43dc-9d1a-7d2b99d3a3a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162668b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:45.519492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0672f448-ab8b-43dc-9d1a-7d2b99d3a3a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053905 Dec 17 13:00:45.520077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1052/2107] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:46.532611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-434cf044-a2b7-41cb-b792-33fc5f1f2908 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:46.582383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-434cf044-a2b7-41cb-b792-33fc5f1f2908 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053947 Dec 17 13:00:46.582955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1056/2108] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:47.598268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-822e0856-70a9-400d-b7b1-980fe1a8fff0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:47.646760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-822e0856-70a9-400d-b7b1-980fe1a8fff0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053901 Dec 17 13:00:47.647332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1053/2109] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:48.660537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1e239923-7b02-4b00-badc-c3c4bf8af348 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:48.709410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1e239923-7b02-4b00-badc-c3c4bf8af348 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053183 Dec 17 13:00:48.709985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1057/2110] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:49.722679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-79dd64f7-fb2f-476e-b404-db9b421e7266 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112760d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:49.776653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-79dd64f7-fb2f-476e-b404-db9b421e7266 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058387 Dec 17 13:00:49.777231 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1054/2111] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:50.790188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b08c20d4-fddb-4d66-9e60-e4e9e92c6e54 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cd4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:50.840008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b08c20d4-fddb-4d66-9e60-e4e9e92c6e54 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053858 Dec 17 13:00:50.841552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1058/2112] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:51.854184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aab5e35f-6811-4dda-9f89-dc0eb03d8cda tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:51.911847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aab5e35f-6811-4dda-9f89-dc0eb03d8cda tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063107 Dec 17 13:00:51.912772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1055/2113] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:52.925081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4cfbd23b-c213-4341-9c33-373e3888f955 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:52.975432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4cfbd23b-c213-4341-9c33-373e3888f955 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054413 Dec 17 13:00:52.976051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1059/2114] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:53.991050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d264d168-2e1b-4e14-8a3a-a2089fbbb7a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:54.038761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d264d168-2e1b-4e14-8a3a-a2089fbbb7a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054365 Dec 17 13:00:54.039330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1056/2115] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:55.054300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6da8564b-6423-4c8c-a44f-9f7a161d9712 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:55.106619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6da8564b-6423-4c8c-a44f-9f7a161d9712 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056431 Dec 17 13:00:55.107386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1060/2116] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:56.119717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8c25d176-cf77-45d4-b460-838d6cbfb5a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:56.168754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8c25d176-cf77-45d4-b460-838d6cbfb5a2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053153 Dec 17 13:00:56.169463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1057/2117] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:57.185130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-73727174-b4bd-4951-863d-861b9b58eae5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:57.235663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-73727174-b4bd-4951-863d-861b9b58eae5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056751 Dec 17 13:00:57.236267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1061/2118] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:58.248641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-25c7b8c2-3093-42b7-bf0c-e42fa2e659f5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:58.297682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-25c7b8c2-3093-42b7-bf0c-e42fa2e659f5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053097 Dec 17 13:00:58.298372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1058/2119] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:00:59.311584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-51d632fb-9d7b-4d71-9dce-952b9e6bcdd8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:00:59.363372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-51d632fb-9d7b-4d71-9dce-952b9e6bcdd8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056232 Dec 17 13:00:59.363943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1062/2120] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:00:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:00.375923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f376b907-8f5a-4c34-82f3-50fb05ba2800 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:00.423751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f376b907-8f5a-4c34-82f3-50fb05ba2800 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052014 Dec 17 13:01:00.424290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1059/2121] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:01.436416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7dfd670f-01f7-4671-a53c-825ad7a5dbeb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f93a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:01.485168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7dfd670f-01f7-4671-a53c-825ad7a5dbeb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052904 Dec 17 13:01:01.486588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1063/2122] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:02.498304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ecef0da9-20bc-4bc5-a224-c31ecd74dd86 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162648b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:02.551100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ecef0da9-20bc-4bc5-a224-c31ecd74dd86 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056839 Dec 17 13:01:02.551838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1060/2123] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:02.641883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:02.642489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:01:02.650228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:01:02.650666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:01:02.651467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:01:02.651902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:01:02.665730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. Dec 17 13:01:02.666347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:01:02.667174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-657e7745-c9ec-41c2-9b5b-e97ce9ff8b18 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 404 len: 111 microversion: 2.20 time: 0.029746 Dec 17 13:01:02.667748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1064/2124] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Dec 17 13:01:02 2021] DELETE /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 17 13:01:02.675912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:02.676616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:01:02.683479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:01:02.683964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:01:02.684752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:01:02.685182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:01:02.699844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. Dec 17 13:01:02.700441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:01:02.701503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d99b4b39-6566-4a45-8c74-57a99d4c3f23 tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b" status: 404 len: 111 microversion: 2.20 time: 0.029251 Dec 17 13:01:02.702070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1061/2125] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 13:01:02 2021] GET /compute/v2.1/servers/2753a8b3-fb9d-4d9c-a5d9-42e5ff6f936b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 17 13:01:03.564601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1650ea27-2820-4351-a6d6-330d5582994f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b0d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:03.613752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1650ea27-2820-4351-a6d6-330d5582994f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052833 Dec 17 13:01:03.614317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1065/2126] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:04.628647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6887a4a8-b091-46c1-8f4b-ebcab194a06b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:04.681308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6887a4a8-b091-46c1-8f4b-ebcab194a06b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058145 Dec 17 13:01:04.682091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1062/2127] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:05.698512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-97b89364-2f61-4b09-b29a-1cac1af322be tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111be940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:05.746870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-97b89364-2f61-4b09-b29a-1cac1af322be tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055454 Dec 17 13:01:05.747736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1066/2128] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:06.763703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-54ad1bc7-e0b4-4e86-9ae8-c5bafd174513 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126edc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:06.818169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-54ad1bc7-e0b4-4e86-9ae8-c5bafd174513 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061024 Dec 17 13:01:06.819008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1063/2129] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:07.835645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c227b90-5b3c-43e5-b3f7-228c32764318 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:07.887663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c227b90-5b3c-43e5-b3f7-228c32764318 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058928 Dec 17 13:01:07.888248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1067/2130] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:08.904384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-672a6d91-986a-487d-b8bd-4accb4716914 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:08.951075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-672a6d91-986a-487d-b8bd-4accb4716914 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052886 Dec 17 13:01:08.951754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1064/2131] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:09.968190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4b183785-5eb5-43c5-a00a-f83fa04a5c3f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11ef7b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:10.017562 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4b183785-5eb5-43c5-a00a-f83fa04a5c3f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056126 Dec 17 13:01:10.018383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1068/2132] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:11.031992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-89711023-8c4e-4cf7-a107-6ba0a5365f7f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162648b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:11.082064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-89711023-8c4e-4cf7-a107-6ba0a5365f7f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054275 Dec 17 13:01:11.082627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1065/2133] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:12.097020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a6e750e-6189-4834-af56-362eff710da2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5eca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:12.150980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a6e750e-6189-4834-af56-362eff710da2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058898 Dec 17 13:01:12.151545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1069/2134] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:13.164591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a1b51e73-b7ed-4425-bad2-f018b5cfc489 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:13.218790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a1b51e73-b7ed-4425-bad2-f018b5cfc489 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058340 Dec 17 13:01:13.219513 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1066/2135] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:14.233893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cdbd0ff1-983f-47fc-80a2-959376025da6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112039d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:14.290212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cdbd0ff1-983f-47fc-80a2-959376025da6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061386 Dec 17 13:01:14.291163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1070/2136] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:15.306304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6ad18a65-0694-41e8-b207-8c9f0c4ba043 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:15.358919 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6ad18a65-0694-41e8-b207-8c9f0c4ba043 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057406 Dec 17 13:01:15.359492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1067/2137] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:16.371936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3aa91440-6b11-4a31-a452-eadf1fef6aa8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122fd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:16.422060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3aa91440-6b11-4a31-a452-eadf1fef6aa8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054080 Dec 17 13:01:16.422678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1071/2138] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:17.434978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4bca5a12-c63e-49dd-8251-c31453213fbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128fdc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:17.483511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4bca5a12-c63e-49dd-8251-c31453213fbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052634 Dec 17 13:01:17.484116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1068/2139] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:18.499491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cf7c023d-59c9-4abd-8bd6-b4e239c8e329 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:18.550548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cf7c023d-59c9-4abd-8bd6-b4e239c8e329 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057602 Dec 17 13:01:18.551107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1072/2140] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:19.563577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6e837078-8e23-4bee-a934-85db53e60f33 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:19.615422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6e837078-8e23-4bee-a934-85db53e60f33 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056021 Dec 17 13:01:19.615998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1069/2141] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:20.628617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fbcc5678-808f-4b41-87dd-bd5bc2af9130 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d849d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:20.679623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fbcc5678-808f-4b41-87dd-bd5bc2af9130 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055095 Dec 17 13:01:20.680199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1073/2142] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:21.692752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66cbddfd-c000-4a0d-ae30-9fb3db0d2bbd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:21.743111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66cbddfd-c000-4a0d-ae30-9fb3db0d2bbd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054578 Dec 17 13:01:21.743710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1070/2143] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:22.759179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3c13803e-7986-4ff9-9854-3090021d1a48 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11ef7b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:22.808502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3c13803e-7986-4ff9-9854-3090021d1a48 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055276 Dec 17 13:01:22.809079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1074/2144] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:23.821311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4d2f290b-c34f-4462-9152-15ed4fb71d99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:23.869985 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4d2f290b-c34f-4462-9152-15ed4fb71d99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053687 Dec 17 13:01:23.875040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1071/2145] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:24.884585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-34022b4b-4871-488e-be8c-01d5df2f8ead tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5eca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:24.935724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-34022b4b-4871-488e-be8c-01d5df2f8ead tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056734 Dec 17 13:01:24.936450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1075/2146] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:25.948514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cd7c842e-e74c-412b-b723-927ae71d7779 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b6040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:26.005404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cd7c842e-e74c-412b-b723-927ae71d7779 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060884 Dec 17 13:01:26.010043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1072/2147] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:27.022404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-82f46778-0e36-4d40-8e3e-037e2030e8ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112033a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:27.072613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-82f46778-0e36-4d40-8e3e-037e2030e8ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057245 Dec 17 13:01:27.073183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1076/2148] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:28.089987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a58aac4-1892-4352-8577-227e9eb1ad1c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:28.143849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a58aac4-1892-4352-8577-227e9eb1ad1c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061238 Dec 17 13:01:28.144408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1073/2149] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:29.156700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4af7064b-737c-486f-ad76-5dc44623c170 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b6700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:29.202498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4af7064b-737c-486f-ad76-5dc44623c170 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050124 Dec 17 13:01:29.203062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1077/2150] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:30.218060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ab884e0-0c8e-47af-9f5d-675785023b99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:30.269532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ab884e0-0c8e-47af-9f5d-675785023b99 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056937 Dec 17 13:01:30.270162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1074/2151] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:31.286497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bb333b96-88a0-403a-81a8-c877a7bfeec0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac1f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:31.335650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bb333b96-88a0-403a-81a8-c877a7bfeec0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056322 Dec 17 13:01:31.336231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1078/2152] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:32.352207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aee2d402-74da-4225-a9c6-953deb05717f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:32.408247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aee2d402-74da-4225-a9c6-953deb05717f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062803 Dec 17 13:01:32.408975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1075/2153] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:33.425910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2ac3296b-f395-4eda-808a-8a252dbc3c08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111eee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:33.478972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2ac3296b-f395-4eda-808a-8a252dbc3c08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059802 Dec 17 13:01:33.479522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1079/2154] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:01:34.493972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-424b77b2-5bda-4582-a344-7a64cb2389c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:34.541338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-424b77b2-5bda-4582-a344-7a64cb2389c9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052810 Dec 17 13:01:34.542046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1076/2155] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:35.557625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a91fd13-2d54-41b1-8f04-9c021b394e6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:35.610305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a91fd13-2d54-41b1-8f04-9c021b394e6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059488 Dec 17 13:01:35.610874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1080/2156] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:36.623189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afe1e7de-2c52-4c54-b96a-6a9f5a8ddb07 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:36.674308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afe1e7de-2c52-4c54-b96a-6a9f5a8ddb07 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055099 Dec 17 13:01:36.674899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1077/2157] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:37.691905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68b32fa3-ac51-4911-b452-ae1ff0c32aec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5edc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:37.743646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68b32fa3-ac51-4911-b452-ae1ff0c32aec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057462 Dec 17 13:01:37.744198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1081/2158] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:38.756673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a56432df-aeb2-403d-aa5a-67fabf7b47a3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:38.809155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a56432df-aeb2-403d-aa5a-67fabf7b47a3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056746 Dec 17 13:01:38.809790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1078/2159] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:39.821521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-04f2a9ee-3cc9-4c8d-a565-b9ee7ec38c4d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9e50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:39.868970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-04f2a9ee-3cc9-4c8d-a565-b9ee7ec38c4d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051625 Dec 17 13:01:39.869584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1082/2160] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:40.885975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-149f4e06-827e-476a-a1f2-50663d38da9f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:40.936039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-149f4e06-827e-476a-a1f2-50663d38da9f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056837 Dec 17 13:01:40.936636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1079/2161] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:41.948773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-82c5b102-ef95-48f7-8c01-e572ad3a3456 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:41.995764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-82c5b102-ef95-48f7-8c01-e572ad3a3456 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050972 Dec 17 13:01:41.996330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1083/2162] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:43.008304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4ff07269-2194-4acb-85c6-f29639f83cd1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:43.053574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4ff07269-2194-4acb-85c6-f29639f83cd1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049264 Dec 17 13:01:43.054146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1080/2163] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:44.065601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7b8bb36a-8237-477b-aafd-80956fdbf36c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:44.112247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7b8bb36a-8237-477b-aafd-80956fdbf36c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050786 Dec 17 13:01:44.112808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1084/2164] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:45.128582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-61dd7090-9ef0-44a6-97a2-44f5e091f92b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:45.183974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-61dd7090-9ef0-44a6-97a2-44f5e091f92b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062453 Dec 17 13:01:45.184559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1081/2165] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:46.197483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76093147-5058-4dd2-bbeb-1ec7c9201f2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c91f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:46.245910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-76093147-5058-4dd2-bbeb-1ec7c9201f2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052676 Dec 17 13:01:46.246522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1085/2166] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:47.258944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-611edb2f-f349-44da-941f-047cf02cf4a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:47.305488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-611edb2f-f349-44da-941f-047cf02cf4a8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050662 Dec 17 13:01:47.306045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1082/2167] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:48.322984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d4e3eea-387d-4bc0-96f2-d4b2ce58519b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:48.372930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d4e3eea-387d-4bc0-96f2-d4b2ce58519b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057193 Dec 17 13:01:48.373532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1086/2168] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:49.389828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4301b4e7-ea8d-4450-8ebf-262851c533a3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:49.444307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4301b4e7-ea8d-4450-8ebf-262851c533a3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061245 Dec 17 13:01:49.444865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1083/2169] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:50.461176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5c0518e0-9d5e-42d0-af18-1c507d696055 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111be9d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:50.512836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5c0518e0-9d5e-42d0-af18-1c507d696055 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058547 Dec 17 13:01:50.513432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1087/2170] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:50.569240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:01:50.569793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:01:51.530503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c7f9d34d-1ffa-4d35-92d6-a9abd5a775eb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11634280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:51.581410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c7f9d34d-1ffa-4d35-92d6-a9abd5a775eb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058577 Dec 17 13:01:51.582270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1084/2171] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:52.597253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1b1a23a4-4581-4439-8938-662d7666b729 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:52.650499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1b1a23a4-4581-4439-8938-662d7666b729 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059407 Dec 17 13:01:52.651069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1088/2172] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:53.667451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-717c488a-5c7a-479a-bb1b-ecc938049e5b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:53.717873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-717c488a-5c7a-479a-bb1b-ecc938049e5b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057094 Dec 17 13:01:53.718439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1085/2173] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:54.733796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-010e9496-1a5e-4edc-8efb-5cedf310409f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:54.786113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-010e9496-1a5e-4edc-8efb-5cedf310409f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058284 Dec 17 13:01:54.786682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1089/2174] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:55.802945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07370c78-3eb5-4c72-a678-f947b2ecabe2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260af0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:55.858320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07370c78-3eb5-4c72-a678-f947b2ecabe2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062156 Dec 17 13:01:55.858883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1086/2175] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:56.871354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b7c152cd-adfa-4ac0-9c7f-3b3f00c50b66 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e40310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:56.920643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b7c152cd-adfa-4ac0-9c7f-3b3f00c50b66 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053454 Dec 17 13:01:56.921210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1090/2176] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:57.936171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a4f9b0e-a11c-4ab0-8981-55d1553cb69e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:57.985402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a4f9b0e-a11c-4ab0-8981-55d1553cb69e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054116 Dec 17 13:01:57.985966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1087/2177] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:01:58.998270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d512bf5b-f8e0-4b6c-80bd-f36bf3dc7eb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:01:59.044815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d512bf5b-f8e0-4b6c-80bd-f36bf3dc7eb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050683 Dec 17 13:01:59.045816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1091/2178] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:01:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:00.061042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6b2b498c-d57d-40ab-8b0a-f239e5d1f135 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:00.112954 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6b2b498c-d57d-40ab-8b0a-f239e5d1f135 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057411 Dec 17 13:02:00.113618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1088/2179] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:01.129125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6c8a538c-3b60-4649-a62a-c4c4f06fdb44 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a0670>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:01.177669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6c8a538c-3b60-4649-a62a-c4c4f06fdb44 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055274 Dec 17 13:02:01.178237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1092/2180] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:02.194345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-220b6786-a6c8-4bcf-bea4-64629b8301d6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e31f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:02.254382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-220b6786-a6c8-4bcf-bea4-64629b8301d6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.066886 Dec 17 13:02:02.255113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1089/2181] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:03.271359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-232ef9c7-63f0-4544-ac35-7d62617d9991 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ace50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:03.325020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-232ef9c7-63f0-4544-ac35-7d62617d9991 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060452 Dec 17 13:02:03.325625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1093/2182] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:04.341305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ece1cc9-9e00-4efd-a88c-787566d03002 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:04.389317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ece1cc9-9e00-4efd-a88c-787566d03002 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053408 Dec 17 13:02:04.389888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1090/2183] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:05.403876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9938c5fd-b43a-44bf-8d79-0c5206f907c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce1f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:05.458680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9938c5fd-b43a-44bf-8d79-0c5206f907c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060134 Dec 17 13:02:05.459777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1094/2184] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:06.472531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2d75d073-6256-402f-8bb3-d80751658534 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3f70>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:06.521711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2d75d073-6256-402f-8bb3-d80751658534 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053712 Dec 17 13:02:06.526250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1091/2185] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:07.534891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-204bc310-e799-497a-bab5-cef12668a9b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:07.583062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-204bc310-e799-497a-bab5-cef12668a9b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052653 Dec 17 13:02:07.583634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1095/2186] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:08.596617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-98693971-f70e-4bb8-a645-6b99237da3b6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:08.649750 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-98693971-f70e-4bb8-a645-6b99237da3b6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057261 Dec 17 13:02:08.650333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1092/2187] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:09.662607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-45798a0a-f0e3-4066-a903-4767fed61fdf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a00d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:09.708448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-45798a0a-f0e3-4066-a903-4767fed61fdf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049984 Dec 17 13:02:09.710727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1096/2188] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:10.721595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d291a305-ad24-4783-adcd-183c9da435fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11315700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:10.768329 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d291a305-ad24-4783-adcd-183c9da435fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050853 Dec 17 13:02:10.768892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1093/2189] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:11.780700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1470c0ba-fe8f-4aaf-bee8-3deff37595d5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ceca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:11.835151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1470c0ba-fe8f-4aaf-bee8-3deff37595d5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058854 Dec 17 13:02:11.835731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1097/2190] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:12.847449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45465072-1be0-4b2a-95a6-f7ba84300aa5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:12.893049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:02:12.893594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45465072-1be0-4b2a-95a6-f7ba84300aa5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049868 Dec 17 13:02:12.893695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:02:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:02:12.897612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1094/2191] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:13.910056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6c6e5f67-9e21-4d84-8f8d-8271eaa88001 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:13.958511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6c6e5f67-9e21-4d84-8f8d-8271eaa88001 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055264 Dec 17 13:02:13.959611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1098/2192] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:14.974462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a62218c8-1e55-4ac8-90dd-eae36f8059ac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:15.024861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a62218c8-1e55-4ac8-90dd-eae36f8059ac tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056676 Dec 17 13:02:15.030326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1095/2193] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:16.041751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-018b7cb2-c64d-41aa-b351-4446f2cf3ea7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122cca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:16.101256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-018b7cb2-c64d-41aa-b351-4446f2cf3ea7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.066318 Dec 17 13:02:16.101842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1099/2194] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:17.114908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-42088a42-db4f-429a-9e76-5fe85d634f97 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:17.167946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-42088a42-db4f-429a-9e76-5fe85d634f97 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057135 Dec 17 13:02:17.168508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1096/2195] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:18.180841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6f0e1dbe-7e5a-4088-adc6-e7de26e38e84 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:18.227702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6f0e1dbe-7e5a-4088-adc6-e7de26e38e84 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051426 Dec 17 13:02:18.232722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1100/2196] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:19.244200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f709b55f-a2c9-45ac-bdb6-0b4ca5123fbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112e3dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:19.296167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f709b55f-a2c9-45ac-bdb6-0b4ca5123fbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058729 Dec 17 13:02:19.296722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1097/2197] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:20.312504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c437f121-1efe-4127-82fd-3d748f467ca4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:20.369861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c437f121-1efe-4127-82fd-3d748f467ca4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064272 Dec 17 13:02:20.370393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1101/2198] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:21.382949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-600e460d-4e02-464a-aff5-6dc046517138 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:21.428590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-600e460d-4e02-464a-aff5-6dc046517138 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049938 Dec 17 13:02:21.429159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1098/2199] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:22.444291 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4d04fb73-8dbc-4887-9405-84fc2f6e0e35 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:22.505700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4d04fb73-8dbc-4887-9405-84fc2f6e0e35 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.068156 Dec 17 13:02:22.506264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1102/2200] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:23.518112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ac9f9e8-4bb8-4d28-8a83-7b5c81fb473d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126ea60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:23.565590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ac9f9e8-4bb8-4d28-8a83-7b5c81fb473d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051578 Dec 17 13:02:23.566233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1099/2201] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:24.582426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cd167c4b-5993-46eb-bf08-64323b5853ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:24.630756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cd167c4b-5993-46eb-bf08-64323b5853ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055212 Dec 17 13:02:24.632321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1103/2202] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:25.647411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-969652c5-54a5-41bb-a721-a8e866f74b57 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16260040>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:25.694754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-969652c5-54a5-41bb-a721-a8e866f74b57 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054146 Dec 17 13:02:25.695352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1100/2203] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:26.711896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-862b6274-236e-48ad-acd4-7b7def5dccb4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:26.765221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-862b6274-236e-48ad-acd4-7b7def5dccb4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060470 Dec 17 13:02:26.765839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1104/2204] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:27.782404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a9cea389-8c86-405a-9a3f-45e7322cd427 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cd30>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:27.837868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a9cea389-8c86-405a-9a3f-45e7322cd427 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062418 Dec 17 13:02:27.838696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1101/2205] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:28.854665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6e5ae118-3786-404a-a3c7-7fde97dd4c01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ee9d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:28.902420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6e5ae118-3786-404a-a3c7-7fde97dd4c01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054308 Dec 17 13:02:28.903028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1105/2206] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:29.919346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bc037142-791a-4344-8489-fd6ded2cb0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:29.982029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bc037142-791a-4344-8489-fd6ded2cb0b9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.069537 Dec 17 13:02:29.982952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1102/2207] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:30.995414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c2a66855-c49d-409d-ad0e-477d5d2bd534 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120cb80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:31.040950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c2a66855-c49d-409d-ad0e-477d5d2bd534 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049629 Dec 17 13:02:31.041596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1106/2208] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:32.054124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b77c2e3d-f1b2-48c8-a8f2-38ccdb54eec1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:32.099355 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b77c2e3d-f1b2-48c8-a8f2-38ccdb54eec1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049371 Dec 17 13:02:32.101836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1103/2209] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:33.112510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-19c4fe41-37f8-4fd0-81aa-de64ead057bf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a0a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:33.161603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-19c4fe41-37f8-4fd0-81aa-de64ead057bf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053116 Dec 17 13:02:33.162180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1107/2210] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:34.174399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7d3f4c1a-3a63-4eca-a825-80874f6da39b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:34.225345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7d3f4c1a-3a63-4eca-a825-80874f6da39b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054783 Dec 17 13:02:34.226134 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1104/2211] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:35.239172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b16215df-edf1-49fa-b78e-dcca7c423bbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:35.291765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b16215df-edf1-49fa-b78e-dcca7c423bbf tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057024 Dec 17 13:02:35.292482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1108/2212] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:36.309390 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7064d682-05cb-4612-9335-3386c30a8753 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162613a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:36.360922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7064d682-05cb-4612-9335-3386c30a8753 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059309 Dec 17 13:02:36.362637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1105/2213] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:37.374073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-80cc23c8-4430-4268-87b4-e9a03d3cb216 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:37.420505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-80cc23c8-4430-4268-87b4-e9a03d3cb216 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050788 Dec 17 13:02:37.421075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1109/2214] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:38.436771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9ff8aa3-21d6-4914-abb3-fbe2bee799ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:38.486606 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9ff8aa3-21d6-4914-abb3-fbe2bee799ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056042 Dec 17 13:02:38.487198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1106/2215] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:39.499827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fbea5ba5-ff9a-4328-9465-c78620aa3778 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:39.557824 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fbea5ba5-ff9a-4328-9465-c78620aa3778 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062069 Dec 17 13:02:39.558764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1110/2216] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:40.573110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6df6e9fc-76fd-4ebe-af16-6d25fc2b93be tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:40.630363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6df6e9fc-76fd-4ebe-af16-6d25fc2b93be tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061117 Dec 17 13:02:40.630967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1107/2217] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:41.643240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eb9a27aa-1dc0-493f-8bb9-1e080c7a4a19 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11203ee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:41.690022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eb9a27aa-1dc0-493f-8bb9-1e080c7a4a19 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050674 Dec 17 13:02:41.690771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1111/2218] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:42.704594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e994ddc6-454f-460d-9a22-0bc12da7164a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112725e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:42.765032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e994ddc6-454f-460d-9a22-0bc12da7164a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.064657 Dec 17 13:02:42.765997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1108/2219] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:43.779298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2ce6e3a8-c323-4223-b389-3274e7a77573 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5790>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:43.827081 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2ce6e3a8-c323-4223-b389-3274e7a77573 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052783 Dec 17 13:02:43.832975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1112/2220] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:44.842137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b5260363-a4b1-41f5-8b74-98c479d118a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c4c0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:44.889209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b5260363-a4b1-41f5-8b74-98c479d118a0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051508 Dec 17 13:02:44.889813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1109/2221] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:45.903012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0d2a8f97-7425-41da-be7e-5bd3b5074fa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a00d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:45.950717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0d2a8f97-7425-41da-be7e-5bd3b5074fa4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052008 Dec 17 13:02:45.951287 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1113/2222] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:46.965497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-36ce981a-55f4-4886-a5b1-1704ee1991d7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:47.067126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-36ce981a-55f4-4886-a5b1-1704ee1991d7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.105736 Dec 17 13:02:47.067797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1110/2223] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:48.080334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0ca3359a-f78f-4468-a022-6ab30224f9d3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122f8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:48.192144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0ca3359a-f78f-4468-a022-6ab30224f9d3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.116026 Dec 17 13:02:48.192752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1114/2224] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:02:49.204968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6ea4afd8-f527-4226-87df-b4ebe3b72b48 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:49.263626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6ea4afd8-f527-4226-87df-b4ebe3b72b48 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062829 Dec 17 13:02:49.268636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1111/2225] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:50.276936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c958075f-f0b0-4ab5-8aa4-c19a0f890388 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:50.323045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c958075f-f0b0-4ab5-8aa4-c19a0f890388 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050391 Dec 17 13:02:50.323607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1115/2226] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:51.336039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dc745b2c-dca6-4f31-8072-3262f4e8ae53 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:51.390171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dc745b2c-dca6-4f31-8072-3262f4e8ae53 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058519 Dec 17 13:02:51.390735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1112/2227] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:52.403392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-edbe9275-6972-46fe-87b8-329d693ab3e6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce1f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:52.452013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-edbe9275-6972-46fe-87b8-329d693ab3e6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052285 Dec 17 13:02:52.452785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1116/2228] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:53.465768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f6426ca-06c9-4ee5-8e7e-cd0f7e6da207 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b85e0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:53.514243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f6426ca-06c9-4ee5-8e7e-cd0f7e6da207 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053130 Dec 17 13:02:53.514818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1113/2229] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:54.527265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c3c05484-180d-44cc-bcd4-616af072a403 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5eca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:54.578226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c3c05484-180d-44cc-bcd4-616af072a403 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055413 Dec 17 13:02:54.578796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1117/2230] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:55.591399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c18ab41-2bfd-480d-9d53-2c230e84e600 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:55.640547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1c18ab41-2bfd-480d-9d53-2c230e84e600 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053036 Dec 17 13:02:55.642018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1114/2231] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:56.654773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f139e760-e698-4d89-b783-9a1abb84ce5d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5a60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:56.702416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f139e760-e698-4d89-b783-9a1abb84ce5d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051765 Dec 17 13:02:56.703357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1118/2232] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:57.718379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a51f11c6-b19a-4d1e-b6d0-d94dd4aaf820 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130ce50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:57.786266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a51f11c6-b19a-4d1e-b6d0-d94dd4aaf820 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.073688 Dec 17 13:02:57.786815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1115/2233] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:58.799364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f3c4ca22-775d-4b9b-b095-1a663aca4246 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a00d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:58.849484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f3c4ca22-775d-4b9b-b095-1a663aca4246 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054199 Dec 17 13:02:58.850052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1119/2234] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:02:59.862426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e71413e-283e-4621-a7fb-f5b54c984dc2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:02:59.909558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e71413e-283e-4621-a7fb-f5b54c984dc2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051209 Dec 17 13:02:59.910176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1116/2235] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:02:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:00.922481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5f5f0269-c9cb-4ecc-b716-7c187f1683fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111bee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:00.972869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5f5f0269-c9cb-4ecc-b716-7c187f1683fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054379 Dec 17 13:03:00.973655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1120/2236] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:01.985754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-21e3ca8e-cda9-45d6-be26-8a9e9e68aaf2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162653a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:02.034499 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-21e3ca8e-cda9-45d6-be26-8a9e9e68aaf2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052690 Dec 17 13:03:02.040488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1117/2237] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:03.150125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-46ad9345-9376-4510-b8c6-30cbc047df2e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111be8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:03.195467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-46ad9345-9376-4510-b8c6-30cbc047df2e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.150879 Dec 17 13:03:03.196037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1121/2238] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:04.210002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5613af97-5320-4ee4-9cc8-67fb37e3cc77 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:04.263105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5613af97-5320-4ee4-9cc8-67fb37e3cc77 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058195 Dec 17 13:03:04.264004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1118/2239] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:05.280256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a24e7262-d27a-445d-96b2-db5876ea4f96 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cef70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:05.326044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a24e7262-d27a-445d-96b2-db5876ea4f96 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050005 Dec 17 13:03:05.326696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1122/2240] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:06.338474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7ac42a4b-3fe7-4c37-9cb1-0a90eccab102 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:06.386637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7ac42a4b-3fe7-4c37-9cb1-0a90eccab102 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052331 Dec 17 13:03:06.387402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1119/2241] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:06 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:07.399594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-686de29d-bbac-4001-9717-1371d00fad38 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:07.457652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-686de29d-bbac-4001-9717-1371d00fad38 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061977 Dec 17 13:03:07.458627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1123/2242] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:08.473449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9eb2f7f-e8a9-4f05-b148-4e2b61f22d97 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16265a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:08.521652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9eb2f7f-e8a9-4f05-b148-4e2b61f22d97 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052257 Dec 17 13:03:08.522326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1120/2243] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:09.535384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1eb97006-b460-45a7-b39c-5a45e52900e5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120cdc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:09.581899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1eb97006-b460-45a7-b39c-5a45e52900e5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050667 Dec 17 13:03:09.582638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1124/2244] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:10.596362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16386841-60c4-4938-a46f-7c24231793ad tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16265b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:10.642762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16386841-60c4-4938-a46f-7c24231793ad tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050497 Dec 17 13:03:10.643322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1121/2245] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:11.656794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-58d245ac-8fa5-4649-9822-707e4cc0503f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112a0040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:11.704276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-58d245ac-8fa5-4649-9822-707e4cc0503f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051590 Dec 17 13:03:11.704844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1125/2246] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:12.718219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dbc27e26-e4db-461e-9e28-bb0021c44267 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130c790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:12.765765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dbc27e26-e4db-461e-9e28-bb0021c44267 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051587 Dec 17 13:03:12.766401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1122/2247] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:13.778651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cde665ec-1433-4adb-8302-23b908b7492f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:13.828911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cde665ec-1433-4adb-8302-23b908b7492f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054459 Dec 17 13:03:13.830539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1126/2248] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:14.843185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-00668c9b-2ec7-4a32-8673-2710662bd1ab tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:14.890221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-00668c9b-2ec7-4a32-8673-2710662bd1ab tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051100 Dec 17 13:03:14.890893 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1123/2249] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:15.904199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8d14cf26-005a-4333-9eb4-de242984d4f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11e96f70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:15.951029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8d14cf26-005a-4333-9eb4-de242984d4f1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051063 Dec 17 13:03:15.951616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1127/2250] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:16.967609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7aab6a27-9101-446e-8939-47c2ee1ab4fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:17.014550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7aab6a27-9101-446e-8939-47c2ee1ab4fb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051290 Dec 17 13:03:17.015333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1124/2251] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:18.028791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-321dd7d9-8750-4442-9633-032fe89d34e0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1120c550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:18.084749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-321dd7d9-8750-4442-9633-032fe89d34e0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059458 Dec 17 13:03:18.086102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1128/2252] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:19.098636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45dde352-d7c3-4804-b6e0-94234a53f12f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16265ca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:19.145603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45dde352-d7c3-4804-b6e0-94234a53f12f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050979 Dec 17 13:03:19.146578 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1125/2253] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:20.160132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-826dea1d-3947-41e3-b18f-717cf0013680 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111acdc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:20.208136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-826dea1d-3947-41e3-b18f-717cf0013680 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051644 Dec 17 13:03:20.208943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1129/2254] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:21.221955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bbf52681-70cf-4490-8446-3d5d6bfea7b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:21.276077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bbf52681-70cf-4490-8446-3d5d6bfea7b5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058479 Dec 17 13:03:21.276822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1126/2255] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:22.289617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4cbcd194-3093-42ee-a91b-544e611cafde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c3b280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:22.337305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4cbcd194-3093-42ee-a91b-544e611cafde tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051779 Dec 17 13:03:22.338030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1130/2256] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:22 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:23.350529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-007ab234-95d4-4e64-b2f9-f4f87d9f242e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8dc0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:23.397188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-007ab234-95d4-4e64-b2f9-f4f87d9f242e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050703 Dec 17 13:03:23.397955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1127/2257] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:24.234619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:03:24.235259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:03:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:03:24.411596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4fa9607d-c0a1-49d5-bd1c-74a3baadb8ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cc550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:24.460987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4fa9607d-c0a1-49d5-bd1c-74a3baadb8ef tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053738 Dec 17 13:03:24.461667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1131/2258] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:25.474683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-98b9fcec-8809-4ff8-bc16-b61451dd53f3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:25.522759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-98b9fcec-8809-4ff8-bc16-b61451dd53f3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052186 Dec 17 13:03:25.523777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1128/2259] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:25.912059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:03:25.912380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:03:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:03:26.536130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ed8f5efa-8a47-4220-9056-e3eb3fe80216 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce1f0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:26.583068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ed8f5efa-8a47-4220-9056-e3eb3fe80216 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051027 Dec 17 13:03:26.583864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1132/2260] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:27.596981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f370d5d3-207a-4af6-acb8-aac78a569637 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:27.643708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f370d5d3-207a-4af6-acb8-aac78a569637 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051347 Dec 17 13:03:27.644297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1129/2261] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:28.656358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4ccc868-6dd2-4ce1-9d11-80489009c1d6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9820>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:28.706448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4ccc868-6dd2-4ce1-9d11-80489009c1d6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054135 Dec 17 13:03:28.707443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1133/2262] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:29.397581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:03:29.397878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:03:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:03:29.720053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3d1379f5-b4da-475b-87bb-901d560948e0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b81f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:29.769002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3d1379f5-b4da-475b-87bb-901d560948e0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053265 Dec 17 13:03:29.770063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1130/2263] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:30.782799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c81d8ebf-1659-4170-a9b6-ba83984be598 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d843a0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:30.830670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c81d8ebf-1659-4170-a9b6-ba83984be598 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052592 Dec 17 13:03:30.831368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1134/2264] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:31.843751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48d1c3a9-05fa-425a-801e-14e61d931c2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264ee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:31.892060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-48d1c3a9-05fa-425a-801e-14e61d931c2c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052357 Dec 17 13:03:31.892709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1131/2265] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:32.905014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bf5e5f81-635d-48d1-bfa8-611b05d2a253 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:32.952089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bf5e5f81-635d-48d1-bfa8-611b05d2a253 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051361 Dec 17 13:03:32.952893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1135/2266] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:03:33.966020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07dc0326-d6f4-482c-a93d-6da3512c115e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:34.014810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07dc0326-d6f4-482c-a93d-6da3512c115e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052995 Dec 17 13:03:34.015630 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1132/2267] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:35.028879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-242a1e00-25cf-4c38-91fc-461e9892d56c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111be700>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:35.076663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-242a1e00-25cf-4c38-91fc-461e9892d56c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051842 Dec 17 13:03:35.077683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1136/2268] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:36.090028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2ba9ba62-0dd7-4c35-a7d4-391586fb37e3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:36.138659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2ba9ba62-0dd7-4c35-a7d4-391586fb37e3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052482 Dec 17 13:03:36.139514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1133/2269] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:37.151755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c53011ce-2149-48bf-952b-0c3a2d2468a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122fc10>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:37.199722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c53011ce-2149-48bf-952b-0c3a2d2468a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052055 Dec 17 13:03:37.200732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1137/2270] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:03:38.213736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-425c7223-cc5a-4755-bee3-eb79574f76a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:38.266209 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-425c7223-cc5a-4755-bee3-eb79574f76a4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057339 Dec 17 13:03:38.266781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1134/2271] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:38 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:38.887769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:03:38.887947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:03:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:03:39.280172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-05696618-36ec-4bf0-8cc9-a12dd0eab78a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111beca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:39.327705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-05696618-36ec-4bf0-8cc9-a12dd0eab78a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052451 Dec 17 13:03:39.328458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1138/2272] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:40.341869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-56a15be1-7242-4807-bca1-5276feb5fc8b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162653a0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:40.398989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-56a15be1-7242-4807-bca1-5276feb5fc8b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062138 Dec 17 13:03:40.399877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1135/2273] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:41.412121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-320060b3-c490-41dc-a42f-f6da9dd87985 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:41.436154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-7a9ee578-416b-4321-ad35-e1861ee96d52 req-625131c3-f43b-4866-9b2e-a8a6eea71d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1ede74-0deb-4b88-af72-a692da9b71ed", "name": "network-vif-deleted", "tag": "b39bee7e-4475-4ebd-8738-43161ffc22d9"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:03:41.438400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:03:41.438400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:03:41.447892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7a9ee578-416b-4321-ad35-e1861ee96d52 req-625131c3-f43b-4866-9b2e-a8a6eea71d69 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:03:41.448363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-7a9ee578-416b-4321-ad35-e1861ee96d52 req-625131c3-f43b-4866-9b2e-a8a6eea71d69 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:03:41.460113 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-7a9ee578-416b-4321-ad35-e1861ee96d52 req-625131c3-f43b-4866-9b2e-a8a6eea71d69 service nova] Creating event network-vif-deleted:b39bee7e-4475-4ebd-8738-43161ffc22d9 for instance 3e1ede74-0deb-4b88-af72-a692da9b71ed on hv-cinder-80152 Dec 17 13:03:41.466995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-7a9ee578-416b-4321-ad35-e1861ee96d52 req-625131c3-f43b-4866-9b2e-a8a6eea71d69 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171860 Dec 17 13:03:41.467837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1139/2274] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:03:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:41.506459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-320060b3-c490-41dc-a42f-f6da9dd87985 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.098464 Dec 17 13:03:41.507034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1136/2275] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:42.519844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-99b69cff-29e4-4029-b031-b41891b9d436 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cef70>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:42.568419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-99b69cff-29e4-4029-b031-b41891b9d436 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052923 Dec 17 13:03:42.568997 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1140/2276] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:43.581451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2e42987-3122-425f-9949-f2bc5590397c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:43.638564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e2e42987-3122-425f-9949-f2bc5590397c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060895 Dec 17 13:03:43.639121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1137/2277] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:44.651568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fe6ee073-90d4-4470-9b45-f2d8ef63bb25 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11c5e940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:44.704238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fe6ee073-90d4-4470-9b45-f2d8ef63bb25 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055946 Dec 17 13:03:44.704643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1141/2278] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:45.717201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-86fcb065-9766-43b7-96fb-3cb84fa3ee85 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11283670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:45.765907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-86fcb065-9766-43b7-96fb-3cb84fa3ee85 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052589 Dec 17 13:03:45.766729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1138/2279] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:46.783814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-01d5d9da-b4f7-415d-bee6-633d383071d8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112030d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:46.835571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-01d5d9da-b4f7-415d-bee6-633d383071d8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055882 Dec 17 13:03:46.836132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1142/2280] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:47.848465 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1cf90e6a-a3d6-4917-bbdb-442bf2da453f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130ce50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:47.900787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1cf90e6a-a3d6-4917-bbdb-442bf2da453f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056457 Dec 17 13:03:47.901385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1139/2281] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:48.914159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7dd45da0-1785-4abb-b4c8-e147f08ecf10 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122fca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:48.965854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7dd45da0-1785-4abb-b4c8-e147f08ecf10 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056493 Dec 17 13:03:48.966437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1143/2282] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:49.982824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c7cd8e1-a37e-4be5-a8c0-09fdbcc464c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11272670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:50.030814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c7cd8e1-a37e-4be5-a8c0-09fdbcc464c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052179 Dec 17 13:03:50.031457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1140/2283] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:51.044869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-611c3387-cceb-4ea7-a391-a0ec2dc46605 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cce50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:51.097654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-611c3387-cceb-4ea7-a391-a0ec2dc46605 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057210 Dec 17 13:03:51.098462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1144/2284] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:52.113267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c28a2ddd-a3a1-47e3-8e11-495c4a6976c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:52.159206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c28a2ddd-a3a1-47e3-8e11-495c4a6976c5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050991 Dec 17 13:03:52.159762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1141/2285] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:53.176324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a5dc212f-76dc-4712-ab86-b04801602f17 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d709d0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:53.237898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a5dc212f-76dc-4712-ab86-b04801602f17 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.068610 Dec 17 13:03:53.238469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1145/2286] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:53 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:54.253991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28a70dae-4d0d-4ba5-bbc7-4e3468ebda83 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:54.321841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28a70dae-4d0d-4ba5-bbc7-4e3468ebda83 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.073889 Dec 17 13:03:54.322438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1142/2287] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:55.335450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8bdf0eed-ac15-4683-95e6-1bd245a92c96 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ccd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:55.382522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8bdf0eed-ac15-4683-95e6-1bd245a92c96 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051927 Dec 17 13:03:55.383110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1146/2288] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:56.397138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8ddb4f56-5d4b-40d7-82d1-dceda370bcfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263310>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:56.446403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8ddb4f56-5d4b-40d7-82d1-dceda370bcfb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054931 Dec 17 13:03:56.446981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1143/2289] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:57.460813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-50fdc43c-fa11-4acc-9846-175c2813a97d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:57.506210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-50fdc43c-fa11-4acc-9846-175c2813a97d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.049801 Dec 17 13:03:57.506777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1147/2290] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:58.519132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-23f284b7-fe23-49e9-83e4-591503e59d6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129d9d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:58.568587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-23f284b7-fe23-49e9-83e4-591503e59d6b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053616 Dec 17 13:03:58.569182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1144/2291] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:03:59.581793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9a500bd7-5ca3-41eb-a108-9ba95c6c544f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9af0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:03:59.630306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9a500bd7-5ca3-41eb-a108-9ba95c6c544f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052437 Dec 17 13:03:59.630912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1148/2292] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:03:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:00.646101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e4d2e4e1-4d8a-491a-b9d0-77457b17036f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e820>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:00.703408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e4d2e4e1-4d8a-491a-b9d0-77457b17036f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063743 Dec 17 13:04:00.704188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1145/2293] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:01.724726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-468499d4-2ad0-427e-816f-1c2c3889df78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac8b0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:01.777530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-468499d4-2ad0-427e-816f-1c2c3889df78 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061636 Dec 17 13:04:01.778092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1149/2294] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:02.791574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c3a65e50-28d6-4916-acf4-f57939197f4e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:02.842294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c3a65e50-28d6-4916-acf4-f57939197f4e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054801 Dec 17 13:04:02.842864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1146/2295] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:03.857560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2ca927ee-1bdc-401e-b592-d6b085bb7e6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b6e50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:03.905709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2ca927ee-1bdc-401e-b592-d6b085bb7e6e tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052225 Dec 17 13:04:03.906438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1150/2296] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:04.920441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2ba58f3-fcc2-4f02-8e9b-2438d38a77c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:04.968343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2ba58f3-fcc2-4f02-8e9b-2438d38a77c1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052496 Dec 17 13:04:04.968928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1147/2297] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:04 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:05.986089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-98f80f45-07d2-4436-b6fa-37cbd2812de3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111eee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:06.035121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-98f80f45-07d2-4436-b6fa-37cbd2812de3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056148 Dec 17 13:04:06.036218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1151/2298] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:05 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:07.051109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4e4e4713-1f49-4e67-83bc-f323b2d73122 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:07.106664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4e4e4713-1f49-4e67-83bc-f323b2d73122 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060167 Dec 17 13:04:07.107268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1148/2299] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:07 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:08.119519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-eafa8266-0dd2-41f9-8991-03ca38f5b2ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ccee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:08.172153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-eafa8266-0dd2-41f9-8991-03ca38f5b2ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.056628 Dec 17 13:04:08.172986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1152/2300] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:08 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:09.184597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3cdd7332-822e-4b8b-9a77-0d30722d9bc0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263790>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:09.233524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3cdd7332-822e-4b8b-9a77-0d30722d9bc0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052658 Dec 17 13:04:09.234234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1149/2301] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:09 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:10.247069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-74a73a8e-8095-43c2-b4a6-e19afe7d1865 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111acdc0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:10.298782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-74a73a8e-8095-43c2-b4a6-e19afe7d1865 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055945 Dec 17 13:04:10.299346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1153/2302] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:10 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:11.312370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9165698-e07e-4d81-80a3-db4f75a9d7eb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1626d280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:11.363748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9165698-e07e-4d81-80a3-db4f75a9d7eb tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055331 Dec 17 13:04:11.364354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1150/2303] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:11 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:12.376754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9b9e3dc4-9e34-4e8a-9a42-69663cf6eb21 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:12.427871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9b9e3dc4-9e34-4e8a-9a42-69663cf6eb21 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054869 Dec 17 13:04:12.431926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1154/2304] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:12 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:13.445946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-200d2a7e-129c-4a48-8453-31183dcfcfb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126eb80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:13.501588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-200d2a7e-129c-4a48-8453-31183dcfcfb8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060640 Dec 17 13:04:13.502151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1151/2305] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:13 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:14.515176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b834d5ac-45a4-43c6-9332-be5ab94c59ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:14.563393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b834d5ac-45a4-43c6-9332-be5ab94c59ea tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052662 Dec 17 13:04:14.563962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1155/2306] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:14 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:15.577115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-98574d88-0569-4a1c-aca5-96849db9cd5d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16261700>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:15.625703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-98574d88-0569-4a1c-aca5-96849db9cd5d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053025 Dec 17 13:04:15.626289 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1152/2307] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:15 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:16.641904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8477bec3-ec2b-442d-be60-898e782a6a2f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ccd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:16.697574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8477bec3-ec2b-442d-be60-898e782a6a2f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.061335 Dec 17 13:04:16.698141 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1156/2308] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:16 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:17.712716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45e7d3af-c308-4b13-b0b6-211dfe732528 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1626dc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:17.760632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45e7d3af-c308-4b13-b0b6-211dfe732528 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052288 Dec 17 13:04:17.761383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1153/2309] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:17 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:18.773254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c81b81fe-8b81-4102-86b2-c2e455561a80 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122c280>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:18.827124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c81b81fe-8b81-4102-86b2-c2e455561a80 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057884 Dec 17 13:04:18.827851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1157/2310] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:18 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:19.841043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-732d8a9e-ffd2-4ec2-a173-77191d38c7c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba162618b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:19.913974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-732d8a9e-ffd2-4ec2-a173-77191d38c7c8 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.077475 Dec 17 13:04:19.914568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1154/2311] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:19 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:20.929805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-781c678e-acad-4336-893c-7456da730ade tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ccd30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:20.983716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-781c678e-acad-4336-893c-7456da730ade tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058625 Dec 17 13:04:20.984454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1158/2312] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:20 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:21.996850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9e38578a-0690-420a-b115-5eb74bc75f71 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1126e430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:22.051124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9e38578a-0690-420a-b115-5eb74bc75f71 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058562 Dec 17 13:04:22.051691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1155/2313] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:21 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:23.066303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0c6e23f7-be03-4c20-92cd-584b770bcaec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ac4c0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:23.120043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0c6e23f7-be03-4c20-92cd-584b770bcaec tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059563 Dec 17 13:04:23.120676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1159/2314] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:23 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:04:24.137025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-700d157f-4b32-4022-92f2-601c58306416 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129d8b0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:24.196285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-700d157f-4b32-4022-92f2-601c58306416 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062469 Dec 17 13:04:24.197693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1156/2315] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:24 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:25.211542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-429a2523-0a4b-46b3-bbc8-9ebc604be2f9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c5b80>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:25.263105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-429a2523-0a4b-46b3-bbc8-9ebc604be2f9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055998 Dec 17 13:04:25.263844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1160/2316] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:25 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:26.276965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6c4d05b-0131-4f32-aef2-9cf5ecb71413 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293a60>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:26.334480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6c4d05b-0131-4f32-aef2-9cf5ecb71413 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059916 Dec 17 13:04:26.335319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1157/2317] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:26 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:27.347414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b3681cc0-5ca5-4ce0-9927-fc16857b3db1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ce550>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:27.395953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b3681cc0-5ca5-4ce0-9927-fc16857b3db1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052671 Dec 17 13:04:27.396532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1161/2318] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:27 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:28.412330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-528a4bbc-ed62-4103-8401-0a1df6295099 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129dca0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:28.464810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-528a4bbc-ed62-4103-8401-0a1df6295099 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.058629 Dec 17 13:04:28.465663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1158/2319] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:28 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:29.478134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a190f3ea-c39b-4921-a5cd-6975e565a6a6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cc310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:29.525177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a190f3ea-c39b-4921-a5cd-6975e565a6a6 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051242 Dec 17 13:04:29.525791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1162/2320] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:29 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:30.538457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-585f5c55-66ab-43e7-b4de-e2105923faca tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1130cc10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:30.584521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-585f5c55-66ab-43e7-b4de-e2105923faca tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050302 Dec 17 13:04:30.585537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1159/2321] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:30 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:04:31.598891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1cdca83d-224d-4d8e-8200-739249278f55 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111d1940>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:31.653459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1cdca83d-224d-4d8e-8200-739249278f55 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059098 Dec 17 13:04:31.654033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1163/2322] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:31 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:32.666311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b8f07738-a1f5-4d85-a385-cba7bf5225fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129daf0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:32.714974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b8f07738-a1f5-4d85-a385-cba7bf5225fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052722 Dec 17 13:04:32.715549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1160/2323] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:32 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:33.727960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4b9f214e-db79-4367-a02a-9748686a1b2a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111ccee0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:33.777993 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4b9f214e-db79-4367-a02a-9748686a1b2a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054197 Dec 17 13:04:33.778558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1164/2324] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:33 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:34.791887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-564224f0-51fa-4112-b68f-7ab5ca1c4d08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:34.840406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-564224f0-51fa-4112-b68f-7ab5ca1c4d08 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053053 Dec 17 13:04:34.840964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1161/2325] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:34 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:04:35.852496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5697899b-5794-494f-ad75-656078ecdab2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111aca60>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:35.900796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5697899b-5794-494f-ad75-656078ecdab2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052346 Dec 17 13:04:35.901431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1165/2326] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:35 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:36.913761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d534380c-60ef-41d6-bf9b-c2f732613413 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16265670>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:36.962649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d534380c-60ef-41d6-bf9b-c2f732613413 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053001 Dec 17 13:04:36.963249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1162/2327] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:36 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:37.976239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-79acd4e1-da60-423e-bfc2-27aaa761e72d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cf310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:38.024056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-79acd4e1-da60-423e-bfc2-27aaa761e72d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052057 Dec 17 13:04:38.024640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1166/2328] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:37 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:39.037237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9379cfb-78d8-4757-83d2-a37da2358697 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba115b8160>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:39.084887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9379cfb-78d8-4757-83d2-a37da2358697 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051341 Dec 17 13:04:39.089562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1163/2329] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:39 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:40.100644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1b17f4fc-7d89-4b00-8796-52ca4bbfe7fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111d1430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:40.149697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1b17f4fc-7d89-4b00-8796-52ca4bbfe7fd tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053024 Dec 17 13:04:40.150844 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1167/2330] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:40 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:41.168625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4fa8fadb-888a-47c9-9956-01eb8092017b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1128f1f0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:41.228288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4fa8fadb-888a-47c9-9956-01eb8092017b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.067506 Dec 17 13:04:41.229045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1164/2331] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:41 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:42.252369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-882642f9-cac0-488d-84ee-bd026a6e00f4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111c9e50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:42.315199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-882642f9-cac0-488d-84ee-bd026a6e00f4 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.069675 Dec 17 13:04:42.316171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1168/2332] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:42 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:43.334774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f67bb0cf-45cb-437b-9ec8-492ce6b5e860 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263ee0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:43.389075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f67bb0cf-45cb-437b-9ec8-492ce6b5e860 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060699 Dec 17 13:04:43.390008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1165/2333] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:43 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:44.404050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ef12aedf-6ded-47d6-9351-bbe0afe1109f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111eee50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:44.454307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ef12aedf-6ded-47d6-9351-bbe0afe1109f tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054189 Dec 17 13:04:44.455134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1169/2334] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:44 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:45.468030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-28b4af7a-c1dc-475a-9500-ec47f53794e9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11283e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:45.538079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-28b4af7a-c1dc-475a-9500-ec47f53794e9 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.074233 Dec 17 13:04:45.538794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1166/2335] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:45 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:46.552422 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a7a3f2a-919f-4ac0-9bcd-5ee1c0d4ed1d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122c310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:46.599763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a7a3f2a-919f-4ac0-9bcd-5ee1c0d4ed1d tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051102 Dec 17 13:04:46.600707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1170/2336] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:46 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:47.613414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3e069123-ba4e-4239-ba96-fd49b849bd4a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:47.666312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3e069123-ba4e-4239-ba96-fd49b849bd4a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.057551 Dec 17 13:04:47.667334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1167/2337] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:47 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:48.679466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1a97e488-2a39-42c6-8289-71c2afba757c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111d1ca0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:48.729117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1a97e488-2a39-42c6-8289-71c2afba757c tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.053543 Dec 17 13:04:48.733358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1171/2338] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:48 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:49.745605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-502a14ea-e6eb-4c2d-a965-73634dbf335b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16265b80>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:49.805600 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-502a14ea-e6eb-4c2d-a965-73634dbf335b tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.065558 Dec 17 13:04:49.806915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1168/2339] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:49 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:50.820575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1fd2eb9c-a541-49a6-8990-f155cd138ee2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111cce50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:50.888560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1fd2eb9c-a541-49a6-8990-f155cd138ee2 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.072330 Dec 17 13:04:50.889644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1172/2340] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:50 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:51.906644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7eb4b08d-aba7-4a40-b99c-b8cb6570ce01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11293550>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:51.970423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7eb4b08d-aba7-4a40-b99c-b8cb6570ce01 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.070152 Dec 17 13:04:51.978430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1169/2341] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:51 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:52.986035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f21ccc6f-faba-4855-b2d6-241327429bb5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111d1d30>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:53.033885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f21ccc6f-faba-4855-b2d6-241327429bb5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051922 Dec 17 13:04:53.034550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1173/2342] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:52 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:54.047147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3efe472c-4e20-4ebe-bf19-f5e1a1521aa7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1129d9d0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:54.096002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3efe472c-4e20-4ebe-bf19-f5e1a1521aa7 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052938 Dec 17 13:04:54.096583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1170/2343] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:54 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:55.109747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-22bf7ab0-c6fc-4077-9834-b6ccf9b57646 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122ce50>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:55.160387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-22bf7ab0-c6fc-4077-9834-b6ccf9b57646 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.055630 Dec 17 13:04:55.161623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1174/2344] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:55 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:56.174488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9b63027f-4f90-4588-afa8-788b392d1bb0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11276280>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:56.223426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9b63027f-4f90-4588-afa8-788b392d1bb0 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.052984 Dec 17 13:04:56.224004 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1171/2345] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:56 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:57.238062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c0220ab8-8a19-4a22-b985-5eb5f3ffd60a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112f9160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:57.294922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c0220ab8-8a19-4a22-b985-5eb5f3ffd60a tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.062490 Dec 17 13:04:57.295490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1175/2346] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:57 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:58.308053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd775127-5770-4c19-81a3-d85f6383be91 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16263940>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:58.362976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd775127-5770-4c19-81a3-d85f6383be91 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.059222 Dec 17 13:04:58.363541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1172/2347] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:58 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:04:59.377161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30989f97-cdc7-4272-8fb2-fc8f92dd1eb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba1122c160>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:04:59.422720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30989f97-cdc7-4272-8fb2-fc8f92dd1eb3 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.050770 Dec 17 13:04:59.423513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1176/2348] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:04:59 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:05:00.438093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-66df662e-6b4b-407e-8deb-8ec119934b41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba112b8c10>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:05:00.494437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-66df662e-6b4b-407e-8deb-8ec119934b41 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.063004 Dec 17 13:05:00.495182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1173/2349] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:05:00 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:05:01.510547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7d40da3c-d418-4398-8a2e-ed44c43fedf1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba111d1430>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:05:01.565098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7d40da3c-d418-4398-8a2e-ed44c43fedf1 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.060773 Dec 17 13:05:01.565743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1177/2350] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:05:01 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:05:02.582181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f9f1d65-22da-482f-8637-942cffd3ac56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba16264e50>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:05:02.629681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f9f1d65-22da-482f-8637-942cffd3ac56 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.054625 Dec 17 13:05:02.630601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1174/2351] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:05:02 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:05:03.642760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90e26cc2-df76-494a-8855-7f6ad68dc9a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] Calling method '.version_select at 0x7fba11d70040>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:05:03.690460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90e26cc2-df76-494a-8855-7f6ad68dc9a5 tempest-VolumesSnapshotsTestJSON-1060463542 tempest-VolumesSnapshotsTestJSON-1060463542-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af" status: 200 len: 344 microversion: 2.1 time: 0.051793 Dec 17 13:05:03.691025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1178/2352] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Dec 17 13:05:03 2021] GET /compute/v2.1/os-volumes/849ad13f-5eff-46dd-b95b-9b60b09765af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:05:10.587561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:05:10.588103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:06:00.505829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:00.506474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:00.512348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:00.512966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:00.513764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:00.514197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:00.539327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:06:00.616477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3a15aabd-a945-4959-9a70-1e98d803cc30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 204 len: 0 microversion: 2.1 time: 0.114748 Dec 17 13:06:00.617089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1175/2353] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:06:00 2021] DELETE /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:06:00.625050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:00.625908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:00.633153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:00.633632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:00.634421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:00.634892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:00.775891 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:00.783469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1f609a5e-10fa-4c8b-8441-296e92688cd6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1507 microversion: 2.1 time: 0.161974 Dec 17 13:06:00.784035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1179/2354] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:00 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:06:01.777949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-3ac3bdb8-130b-442c-bedf-f43e78eee378 req-218fef22-92e2-4bb4-95a4-355971bfad34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff9ce5c-0be8-4a60-a8fb-07a859af79be", "name": "network-vif-deleted", "tag": "861c09f7-e685-428c-883b-0b264853eca6"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:06:01.780001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:06:01.780001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:06:01.788323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3ac3bdb8-130b-442c-bedf-f43e78eee378 req-218fef22-92e2-4bb4-95a4-355971bfad34 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:01.788791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3ac3bdb8-130b-442c-bedf-f43e78eee378 req-218fef22-92e2-4bb4-95a4-355971bfad34 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:01.801378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-3ac3bdb8-130b-442c-bedf-f43e78eee378 req-218fef22-92e2-4bb4-95a4-355971bfad34 service nova] Creating event network-vif-deleted:861c09f7-e685-428c-883b-0b264853eca6 for instance dff9ce5c-0be8-4a60-a8fb-07a859af79be on hv-cinder-80152 Dec 17 13:06:01.801643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:01.805491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:01.806437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-3ac3bdb8-130b-442c-bedf-f43e78eee378 req-218fef22-92e2-4bb4-95a4-355971bfad34 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Dec 17 13:06:01.811166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1176/2355] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:06:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:06:01.824092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:01.825987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:01.827372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:01.827818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:01.894390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:01.902211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-25016b47-86b8-41db-9bf0-654bda980944 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 200 len: 1293 microversion: 2.1 time: 0.105963 Dec 17 13:06:01.902795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1180/2356] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:01 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:02.921124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:02.921740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: dff9ce5c-0be8-4a60-a8fb-07a859af79be] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:02.928382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:02.928829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:02.929718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:02.930173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:02.943908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] HTTP exception thrown: Instance dff9ce5c-0be8-4a60-a8fb-07a859af79be could not be found. Dec 17 13:06:02.944485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Returning 404 to user: Instance dff9ce5c-0be8-4a60-a8fb-07a859af79be could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:06:02.945335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fb565425-3ec9-4262-9f98-6353a8516d6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be" status: 404 len: 111 microversion: 2.1 time: 0.028831 Dec 17 13:06:02.945881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1177/2357] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:02 2021] GET /compute/v2.1/servers/dff9ce5c-0be8-4a60-a8fb-07a859af79be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:06:02.954197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:02.954721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:02.961910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:02.962367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:02.963147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:02.963572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:02.988431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:06:03.070306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a09de229-5c68-49f7-ab35-cb10f94863a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 204 len: 0 microversion: 2.1 time: 0.119481 Dec 17 13:06:03.071127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1181/2358] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:06:02 2021] DELETE /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:06:03.080027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:03.080656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:03.087220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:03.087661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:03.088426 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:03.088849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:03.221174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:03.229850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f10b2c1-12fc-4717-a865-bb4f3c5bacee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.153755 Dec 17 13:06:03.230435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1178/2359] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:04.247702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:04.248398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:04.255024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:04.255470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:04.256257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:04.256659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:04.711857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:04.725166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-02bda82b-0fd2-4178-8b0c-7addbf8ebd72 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1566 microversion: 2.1 time: 0.481476 Dec 17 13:06:04.725999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1182/2360] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1566 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:04.773019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-9ed5ff90-1fbc-4c23-8527-3ecf973da365 req-5d8d8b30-b2df-4c1e-bd36-3afbf828e53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d1af76-68e9-4515-8374-ecae895e7c09", "name": "network-vif-deleted", "tag": "463f65d4-93e2-4912-bcb9-b68da01362d5"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:06:04.775065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:06:04.775065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:06:04.784249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9ed5ff90-1fbc-4c23-8527-3ecf973da365 req-5d8d8b30-b2df-4c1e-bd36-3afbf828e53f service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:04.784689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9ed5ff90-1fbc-4c23-8527-3ecf973da365 req-5d8d8b30-b2df-4c1e-bd36-3afbf828e53f service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:04.795958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-9ed5ff90-1fbc-4c23-8527-3ecf973da365 req-5d8d8b30-b2df-4c1e-bd36-3afbf828e53f service nova] Creating event network-vif-deleted:463f65d4-93e2-4912-bcb9-b68da01362d5 for instance 21d1af76-68e9-4515-8374-ecae895e7c09 on hv-cinder-80152 Dec 17 13:06:04.800961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-9ed5ff90-1fbc-4c23-8527-3ecf973da365 req-5d8d8b30-b2df-4c1e-bd36-3afbf828e53f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Dec 17 13:06:04.801683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1179/2361] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:06:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:06:05.742401 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:05.742963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:05.749865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:05.750317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:05.751104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:05.751538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:05.810608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:05.819159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-10110aa1-4141-4aea-bbf3-a715ad434828 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080464 Dec 17 13:06:05.819730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1183/2362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:06.837335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:06.838054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:06.844649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:06.845064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:06.845894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:06.846323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:06.908726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:06.916891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8e5ba174-d56e-4e67-949b-293aee7ed288 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084488 Dec 17 13:06:06.917490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1180/2363] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:07.933949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:07.934531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:07.941304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:07.941704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:07.942483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:07.942913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:08.001581 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:08.009936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a52e29d8-f973-4ceb-84a6-abef572744c4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079697 Dec 17 13:06:08.010542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1184/2364] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:09.027027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:09.027639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:09.034316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:09.034763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:09.035535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:09.035970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:09.096918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:09.104864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-716dcc05-23eb-4fa8-b93d-94b927e562b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081550 Dec 17 13:06:09.105857 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1181/2365] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:10.122907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:10.123551 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:10.130288 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:10.130721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:10.131490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:10.131913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:10.190302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:10.198643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9cb8cb32-d9c3-4640-9bb2-feabd778c733 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079501 Dec 17 13:06:10.199198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1185/2366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:11.215442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:11.216025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:11.222581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:11.223031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:11.223810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:11.224243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:11.282749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:11.290831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-72b84a7e-a60b-4272-82b4-64ae9b7a8ac9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079485 Dec 17 13:06:11.291402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1182/2367] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:12.307687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:12.308314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:12.315016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:12.315459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:12.316225 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:12.316654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:12.378498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:12.386704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7abafd82-7f8e-46de-ac5b-5d57a8dfcfa5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082863 Dec 17 13:06:12.387277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1186/2368] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:13.403181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:13.403782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:13.410952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:13.411401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:13.412251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:13.412675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:13.480552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:13.489079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-83ee7cb5-f164-4763-99a3-9d1fc1dbb96b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089576 Dec 17 13:06:13.489681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1183/2369] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:14.506057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:14.506689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:14.513314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:14.513758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:14.514526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:14.514953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:14.573599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:14.581934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1082e44a-f94e-489e-8197-f84a4a262f82 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079581 Dec 17 13:06:14.582534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1187/2370] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:15.599512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:15.600145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:15.606871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:15.607318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:15.608133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:15.608559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:15.667162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:15.675589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9480f861-0b45-46be-bbb3-e7507696e42a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079764 Dec 17 13:06:15.676166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1184/2371] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:16.693187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:16.693851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:16.700642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:16.701085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:16.701902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:16.702335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:16.762484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:16.770509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b6cf406e-c2ee-4736-b93a-6e4c90e1590e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081121 Dec 17 13:06:16.771079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1188/2372] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:17.786535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:17.787142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:17.793981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:17.794430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:17.795212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:17.795648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:17.858034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:17.866671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8f3f7163-c868-4091-807c-e3b4e4398ab7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083793 Dec 17 13:06:17.867245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1185/2373] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:18.883423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:18.884048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:18.890592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:18.891043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:18.891837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:18.892267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:18.951315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:18.959087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-972c57b2-46af-4f30-b928-2e8a4a648aad tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079493 Dec 17 13:06:18.959630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1189/2374] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:19.978691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:19.979276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:19.985856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:19.986294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:19.987056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:19.987478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:20.048712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:20.057002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f95fded4-6c94-46a3-8dcb-5530af65c576 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083506 Dec 17 13:06:20.057610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1186/2375] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:21.073982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:21.074652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:21.082269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:21.082652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:21.083457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:21.083893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:21.142996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:21.151089 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-41983c99-47c3-49b0-9be0-8c9a28c282ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081191 Dec 17 13:06:21.151652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1190/2376] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:22.168173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:22.168808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:22.175293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:22.175736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:22.176504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:22.176931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:22.236521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:22.245450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cc2643d7-881f-4914-b9d3-a97c08bdde4f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081098 Dec 17 13:06:22.246020 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1187/2377] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:23.262242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:23.262856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:23.269586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:23.270035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:23.270825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:23.271258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:23.330273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:23.338781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-01e2b9d3-8ebf-4c93-b25a-c882a11cb2a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080224 Dec 17 13:06:23.339368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1191/2378] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:24.355525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:24.356187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:24.362859 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:24.363299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:24.364077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:24.364507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:24.424727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:24.433297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c9343bfc-3484-4716-87c0-208f6b01b08c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081501 Dec 17 13:06:24.433887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1188/2379] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:25.455046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:25.455642 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:25.462661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:25.463164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:25.463960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:25.464386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:25.527366 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:25.535933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-24e043af-aa4b-424b-96dd-44511365f531 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084637 Dec 17 13:06:25.536546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1192/2380] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:26.552251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:26.552879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:26.559918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:26.560368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:26.561251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:26.561710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:26.621723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:26.630341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-417fb38c-eee6-4593-9a2c-cb430b225958 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081817 Dec 17 13:06:26.630942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1189/2381] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:27.647855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:27.648494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:27.655384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:27.655828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:27.656595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:27.657020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:27.716524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:27.725205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-39945b05-3464-4ec1-8d30-c6c74af37749 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081120 Dec 17 13:06:27.725819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1193/2382] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:28.742029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:28.742640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:28.749692 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:28.750133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:28.750902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:28.751324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:28.812395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:28.821059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55bcca57-87a7-4386-a35b-beb2f1eba5f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082717 Dec 17 13:06:28.821677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1190/2383] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:29.838879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:29.839448 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:29.846238 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:29.846674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:29.847458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:29.847899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:29.908139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:29.917451 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-14f10864-65dc-41e4-8f2e-45d517a7a0e9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082981 Dec 17 13:06:29.918032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1194/2384] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:30.934349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:30.934927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:30.941772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:30.942256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:30.943029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:30.943454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:31.002681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:31.010733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06b1c024-3155-4165-8f75-534cd3b32334 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080164 Dec 17 13:06:31.011301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1191/2385] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:32.027522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:32.028151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:32.034794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:32.035240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:32.036020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:32.036444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:32.098820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:32.107579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dade4d15-592f-494d-8998-ca80383a0848 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083684 Dec 17 13:06:32.108206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1195/2386] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:33.124166 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:33.124883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:33.131662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:33.132221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:33.133000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:33.133459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:33.197940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:33.206079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a51e2edc-2e9a-46eb-8722-765b7678f441 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085551 Dec 17 13:06:33.206666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1192/2387] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:34.223190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:34.223833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:34.230483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:34.230930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:34.231701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:34.232130 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:34.291757 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:34.299806 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2fa7acc3-e283-4e29-acac-6d2b1866bc19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080330 Dec 17 13:06:34.300400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1196/2388] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:35.317442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:35.318062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:35.324858 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:35.325306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:35.326128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:35.326561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:35.386627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:35.394943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8a9ad0b6-ea44-44e6-88b0-4c722e519394 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081339 Dec 17 13:06:35.395560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1193/2389] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:36.411091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:36.411720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:36.418460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:36.418910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:36.419696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:36.420126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:36.479615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:36.487988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f9d8ba84-435e-4b7e-b1ed-253ac49633ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080619 Dec 17 13:06:36.488561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1197/2390] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:37.505125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:37.505786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:37.512614 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:37.513051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:37.513887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:37.514324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:37.573757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:37.581703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8438fd24-63e1-4cf4-998a-6e1a453d8491 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080307 Dec 17 13:06:37.582267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1194/2391] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:38.599118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:38.599769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:38.606493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:38.606947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:38.607742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:38.608176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:38.670547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:38.679047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a27a896c-cc51-4019-8a6f-f566436c48ca tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083670 Dec 17 13:06:38.679680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1198/2392] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:39.696095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:39.696757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:39.703450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:39.703896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:39.704671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:39.705104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:39.764050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:39.772091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f92b4389-be37-45aa-8375-26ce8f191b19 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079809 Dec 17 13:06:39.772693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1195/2393] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:40.788948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:40.789785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:40.796607 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:40.797053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:40.797869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:40.798294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:40.859303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:40.867648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7a8397aa-19f3-429d-914f-b1fe28353ffe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082554 Dec 17 13:06:40.868256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1199/2394] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:41.884380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:41.884979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:41.891749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:41.892199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:41.892972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:41.893455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:41.952356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:41.960627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-69dcbcd4-eec6-4005-a09c-8b6fb6bd1ebb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079654 Dec 17 13:06:41.961149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1196/2395] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:42.977895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:42.978602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:42.985164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:42.985660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:42.986429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:42.986862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:43.045391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:43.053699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fd0c9648-5d09-4dbd-86ce-40558565cf5d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079531 Dec 17 13:06:43.054279 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1200/2396] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:44.070552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:44.071173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:44.077899 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:44.078343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:44.079118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:44.079550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:44.137797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:44.145883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-635f9201-9387-4271-99c8-17af7bcafd01 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079068 Dec 17 13:06:44.146471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1197/2397] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:44.253101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:06:44.253761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:06:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:06:45.162341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:45.162982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:45.169971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:45.170413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:45.171198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:45.171627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:45.231158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:45.239277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7c9ae50a-1611-4df8-964f-f6eb49b45dd5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081008 Dec 17 13:06:45.239846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1201/2398] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:45.930747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:06:45.931344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:06:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:06:46.256043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:46.256649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:46.263514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:46.263958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:46.264737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:46.265164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:46.327480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:46.335951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-064e67b5-7e6b-47a0-afe5-2473b7f04887 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083557 Dec 17 13:06:46.336524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1198/2399] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:47.353456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:47.354104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:47.360790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:47.361240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:47.362048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:47.362485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:47.421493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:47.429818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8fceeacc-2d31-4fc2-82af-5cbb8661299c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080127 Dec 17 13:06:47.430388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1202/2400] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:48.446573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:48.447244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:48.453878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:48.454328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:48.455202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:48.455637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:48.516110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:48.524603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d3492092-ab16-4cc3-8511-149007706a89 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081818 Dec 17 13:06:48.525208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1199/2401] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:49.415798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:06:49.416437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:06:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:06:49.541583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:49.542193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:49.548747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:49.549193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:49.550010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:49.550442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:49.609597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:49.618040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-991f9518-1c1c-42ec-9cc2-7d19af096eff tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080398 Dec 17 13:06:49.618615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1203/2402] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:50.635048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:50.635719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:50.642296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:50.642736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:50.643504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:50.643958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:50.702730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:50.711018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f118bdfa-b416-478e-b646-5d3f04208c4a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079945 Dec 17 13:06:50.711575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1200/2403] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:51.728687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:51.729262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:51.736392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:51.736825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:51.737702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:51.738138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:51.805644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:51.814550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1db20c99-f0d9-4648-9bf0-fb3ea6fda973 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089523 Dec 17 13:06:51.815106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1204/2404] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:52.832756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:52.833377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:52.840583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:52.841027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:52.841843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:52.842272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:52.903879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:52.912624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5dd16649-ff73-443d-a8dc-d60fec8db56f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083627 Dec 17 13:06:52.913325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1201/2405] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:53.930093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:53.930724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:53.937564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:53.938006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:53.938778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:53.939203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:53.999172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:54.007259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f5c04b94-2c11-4fc7-b637-ef56ffc00dc5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080775 Dec 17 13:06:54.007855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1205/2406] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:55.024062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:55.024678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:55.031418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:55.031869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:55.032646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:55.033078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:55.091848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:55.100135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-add48096-a9ce-4337-ab83-54ffb1e783c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079851 Dec 17 13:06:55.100789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1202/2407] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:56.116905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:56.117533 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:56.124379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:56.124832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:56.125646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:56.126077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:56.185634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:56.193701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bee667e0-6910-427e-ac28-cc71ec7868d2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080534 Dec 17 13:06:56.194275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1206/2408] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:57.210283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:57.210879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:57.217951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:57.218394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:57.219167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:57.219602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:57.277671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:57.285624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-65077af5-7742-4ef5-b45f-10af6687d08a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079085 Dec 17 13:06:57.286193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1203/2409] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:58.302235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:58.302858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:58.309796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:58.310248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:58.311023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:58.311491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:58.371444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:58.379424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-62443d9b-603a-4404-9f87-1fc2bbafcf79 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080982 Dec 17 13:06:58.379988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1207/2410] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:06:59.396342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:06:59.396961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:06:59.403701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:59.404140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:59.404929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:06:59.405380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:06:59.469057 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:06:59.477593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-583c2442-7cfa-47b7-8ae8-25aaf3dbaf75 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084923 Dec 17 13:06:59.478295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1204/2411] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:06:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:00.494863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:00.495476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:00.502249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:00.502697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:00.503478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:00.503908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:00.575675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:00.583845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-569a466c-1488-4fd6-94b1-e9fd80c1a437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092766 Dec 17 13:07:00.584379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1208/2412] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:01.601573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:01.602177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:01.608730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:01.609180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:01.609996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:01.610432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:01.676549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:01.685036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07e0782b-89cb-4546-83b3-4beb05ccb6ba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087227 Dec 17 13:07:01.685648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1205/2413] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:02.702363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:02.703407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:02.714488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:02.715252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:02.716547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:02.717315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:02.782619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:02.792343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d5f32f81-acb4-49ae-ac07-e475e2e97729 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094082 Dec 17 13:07:02.792910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1209/2414] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:03.808940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:03.809702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:03.817268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:03.817752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:03.818514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:03.818943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:03.878841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:03.887102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da5a3d87-476f-43b3-9440-8d63a44405b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081916 Dec 17 13:07:03.887674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1206/2415] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:04.904282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:04.904916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:04.911641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:04.912079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:04.912850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:04.913390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:04.986830 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:05.000054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-117f2c51-7a42-447d-89b5-ab04d0b8b7a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099232 Dec 17 13:07:05.000963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1210/2416] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:06.018901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:06.019508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:06.026098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:06.026538 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:06.027305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:06.027730 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:06.087727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:06.096107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1a807da2-fe9b-49e1-b488-68fbbffb89a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081040 Dec 17 13:07:06.096682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1207/2417] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:07.113027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:07.113646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:07.120504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:07.120944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:07.121760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:07.122190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:07.182836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:07.191454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7ca7c86-3d7e-4d22-a8a8-69367f753baf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082232 Dec 17 13:07:07.192028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1211/2418] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:08.207887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:08.208519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:08.215913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:08.216366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:08.217152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:08.217621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:08.278187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:08.286194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8af4c577-4098-44c1-a1b1-37e1d516fbda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081994 Dec 17 13:07:08.286755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1208/2419] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:09.303282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:09.303926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:09.310650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:09.311104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:09.311882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:09.312317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:09.371348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:09.379580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2953706b-e2be-4b8f-acfa-59e25a5bc77d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080024 Dec 17 13:07:09.380140 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1212/2420] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:10.396532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:10.397197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:10.404005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:10.406977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:10.406977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:10.406977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:10.466045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:10.474083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0c087cd5-4915-4135-8e79-e20933221f31 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081594 Dec 17 13:07:10.474653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1209/2421] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:11.490995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:11.491676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:11.498597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:11.499046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:11.499828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:11.500260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:11.560171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:11.568625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-394c861c-448c-41af-90c6-ee642893d759 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081337 Dec 17 13:07:11.569236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1213/2422] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:12.589615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:12.590297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:12.599997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:12.600631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:12.601733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:12.602159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:12.678287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:12.688144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a1f1b0d-1dd3-491a-9c58-88991e6d80fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.104607 Dec 17 13:07:12.689093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1210/2423] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:13.709740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:13.710670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:13.719125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:13.719586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:13.720403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:13.720843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:13.780072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:13.788383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d71ac52d-36e4-417e-9da0-82eda46afe20 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083865 Dec 17 13:07:13.788975 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1214/2424] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:14.808212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:14.809108 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:14.820210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:14.820653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:14.821463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:14.821891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:14.882552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:14.894403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-839d22f8-2351-4a5a-b2ab-9b68a48278dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091498 Dec 17 13:07:14.895143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1211/2425] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:15.915387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:15.916346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:15.926786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:15.927558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:15.928942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:15.929666 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:15.988442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:15.996944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ede91792-1b31-4b04-a815-eac21d4b957b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088054 Dec 17 13:07:15.997547 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1215/2426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:17.020572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:17.021226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:17.030449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:17.031058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:17.032182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:17.032832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:17.097201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:17.105113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9043dd4f-1fea-4981-b410-fb479c3f63fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089907 Dec 17 13:07:17.105716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1212/2427] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:18.124564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:18.125509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:18.135368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:18.136083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:18.137343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:18.138087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:18.205106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:18.213779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b0a4a246-1527-4924-b949-5125ff5d1939 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095285 Dec 17 13:07:18.214342 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1216/2428] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:19.236882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:19.237863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:19.248342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:19.249133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:19.250449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:19.251188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:19.312966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:19.321159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-09f723ab-df1b-4a31-812e-2b0b74e8a010 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090477 Dec 17 13:07:19.321795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1213/2429] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:20.341826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:20.342804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:20.352879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:20.353718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:20.355008 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:20.355727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:20.423708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:20.436258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7238097a-0d96-46f9-9325-227500ca918c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.100624 Dec 17 13:07:20.437025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1217/2430] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:21.460937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:21.461972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:21.472471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:21.473214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:21.474540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:21.475272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:21.535835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:21.544484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9672b9bb-989d-4905-91c7-d0f968edf1e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089652 Dec 17 13:07:21.545059 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1214/2431] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:22.564970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:22.565948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:22.576655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:22.577449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:22.578724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:22.579437 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:22.642336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:22.650654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11ab12a9-e064-4155-86db-e0e8ec147e1e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091781 Dec 17 13:07:22.651214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1218/2432] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:23.670595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:23.671398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:23.680040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:23.680697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:23.681789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:23.682374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:23.751189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:23.759222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6bc2a98b-5647-4073-84d5-1afb2b73b53d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094313 Dec 17 13:07:23.759789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1215/2433] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:24.778296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:24.778939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:24.785703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:24.786144 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:24.786876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:24.787346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:24.846230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:24.854410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5694da07-8477-46bd-8835-fef4350d46dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081185 Dec 17 13:07:24.855024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1219/2434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:25.874644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:25.875628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:25.885701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:25.886158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:25.886928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:25.887352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:25.957489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:25.966225 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dcdb1868-e41c-419c-82fa-a2377a030f06 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097814 Dec 17 13:07:25.966848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1216/2435] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:26.987038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:26.988069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:26.998733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:26.999469 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:27.000754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:27.001539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:27.066987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:27.075652 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-35bd6378-12e9-4043-969d-fef5a4ef8bb2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094946 Dec 17 13:07:27.076218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1220/2436] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:28.095979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:28.096948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:28.107357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:28.108102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:28.109469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:28.110199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:28.172812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:28.180742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1c446196-0a18-4410-9aa4-bda78a60d5ea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091005 Dec 17 13:07:28.181307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1217/2437] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:29.198192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:29.198793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:29.205617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:29.206070 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:29.206850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:29.207290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:29.265977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:29.274090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1afe83c8-4e28-4866-ab75-d04dca2dfcdb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079761 Dec 17 13:07:29.274685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1221/2438] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:30.291831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:30.293013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:30.299772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:30.300252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:30.301109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:30.301609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:30.363132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:30.371092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9b26531-8e16-4437-a6a4-e216f1eb9166 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083299 Dec 17 13:07:30.371675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1218/2439] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:31.389624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:31.390314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:31.396917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:31.397370 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:31.398153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:31.398588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:31.478278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:31.486929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6c2e8467-c3e1-49d8-9ba3-b6daa625e6fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.102144 Dec 17 13:07:31.487517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1222/2440] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:32.507478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:32.508528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:32.516506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:32.516955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:32.517756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:32.518186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:32.587860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:32.595961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ad98e58b-d978-4a05-9bc4-e75d8fed94cf tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094673 Dec 17 13:07:32.596531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1219/2441] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:33.613372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:33.614169 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:33.620504 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:33.620979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:33.621846 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:33.622275 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:33.685252 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:33.698246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-65077ede-ecfc-40dc-afb6-fedf4b912c1b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088330 Dec 17 13:07:33.699272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1223/2442] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:34.717727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:34.718469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:34.724918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:34.725387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:34.726163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:34.726564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:34.796237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:34.805094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b200e62-b4e9-4fd9-a7e9-d1000b12cb7f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091042 Dec 17 13:07:34.805932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1220/2443] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:35.823207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:35.823841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:35.831039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:35.831493 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:35.832286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:35.832722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:35.902090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:35.910602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3e3501ea-899e-44f1-b982-446ad420b1d7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091635 Dec 17 13:07:35.911184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1224/2444] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:36.931572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:36.932517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:36.943301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:36.944030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:36.945330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:36.946062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:37.008877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:37.018885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-17fbc700-46e6-4f58-931b-7f93a918a575 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093479 Dec 17 13:07:37.019458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1221/2445] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:38.035967 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:38.036593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:38.043231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:38.043679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:38.044468 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:38.044898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:38.110755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:38.118964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a2fc887-3a51-4683-a34e-fe2cd856c83a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086701 Dec 17 13:07:38.119546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1225/2446] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:39.135897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:39.136498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:39.143521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:39.143950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:39.144756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:39.145188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:39.208301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:39.216828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3dc90ab3-f123-4072-9b3e-bda9c9a5904a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084770 Dec 17 13:07:39.217423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1222/2447] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:40.235129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:40.235902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:40.243110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:40.243553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:40.244478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:40.244899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:40.306162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:40.314240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-62edd910-b210-4d9d-ab54-21dc04bcd91d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083795 Dec 17 13:07:40.314847 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1226/2448] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:41.331203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:41.331840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:41.339330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.339736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.340523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.340950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.402222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:41.410674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-27609954-95ef-4179-b0f0-23c1c28568ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083235 Dec 17 13:07:41.411219 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1223/2449] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:41.736308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:41.736780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:41.743197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.743807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.744654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.745188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.758884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. Dec 17 13:07:41.759457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:07:41.760307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1504e373-8267-4414-b54e-b1a50a70b36e tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 404 len: 111 microversion: 2.20 time: 0.027942 Dec 17 13:07:41.760851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1227/2450] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Dec 17 13:07:41 2021] DELETE /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 17 13:07:41.769148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:41.769925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] [instance: 30ef64cd-7c51-44b7-917c-14ff209e0f81] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:41.776334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.777042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.777726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:41.778221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:41.791701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] HTTP exception thrown: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. Dec 17 13:07:41.792333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] Returning 404 to user: Instance 30ef64cd-7c51-44b7-917c-14ff209e0f81 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:07:41.793172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5834bc2e-3d87-4ff6-948c-86826097fecb tempest-AttachVolumeShelveTestJSON-253167283 tempest-AttachVolumeShelveTestJSON-253167283-project] 10.222.0.45 "GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81" status: 404 len: 111 microversion: 2.20 time: 0.027981 Dec 17 13:07:41.793765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1224/2451] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Dec 17 13:07:41 2021] GET /compute/v2.1/servers/30ef64cd-7c51-44b7-917c-14ff209e0f81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 17 13:07:42.427116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:42.427719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:42.434415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:42.434875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:42.435657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:42.436071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:42.496337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:42.504413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d8e50b33-152e-4225-b371-aab29e90e7dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080989 Dec 17 13:07:42.505062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1228/2452] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:43.521364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:43.522116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:43.529183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:43.529796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:43.530650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:43.531036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:43.610996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:43.619102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bf2a9d16-ade6-4f38-89e1-c719a7bc739f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.101342 Dec 17 13:07:43.619694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1225/2453] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:44.636142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:44.637471 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:44.644194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:44.645045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:44.646068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:44.646502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:44.713628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:44.721951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c92bb7a2-9ec3-4e09-8ca7-98939dbca677 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089560 Dec 17 13:07:44.722539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1229/2454] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:45.744794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:45.745993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:45.760785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:45.761602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:45.762961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:45.763688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:45.854121 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:45.865952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-31f6cae3-d977-48d5-b641-9e16889a10d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.129692 Dec 17 13:07:45.866786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1226/2455] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:46.882772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:46.883353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:46.889798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:46.890234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:46.891045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:46.891489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:46.957052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:46.966568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8f04a475-14a4-4d51-937f-6bd06be78db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087443 Dec 17 13:07:46.967131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1230/2456] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:47.985580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:47.986737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:47.995083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:47.995523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:47.996344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:47.996769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:48.215501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:48.224709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f17f919-9ee7-463d-a0db-ca50ab586492 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.243194 Dec 17 13:07:48.225326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1227/2457] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:49.241625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:49.242229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:49.249537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:49.250187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:49.251214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:49.251817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:49.386138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:49.396005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-efd3fc34-47d0-4ae0-ad3d-30c71fad9902 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.157492 Dec 17 13:07:49.406872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1231/2458] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:50.413428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:50.414123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:50.421461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:50.421872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:50.422874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:50.423460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:50.523981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:50.536397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-316e740d-b2f2-4935-b316-ecbe5f0070fa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.126692 Dec 17 13:07:50.537482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1228/2459] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:50.733810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: .version_select at 0x7fba1622d4c0>, body: {"keypair": {"name": "tempest-keypair-1052580289"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:07:50.748188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:07:50.751879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:07:50.963461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:07:50.967152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:07:50.980611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-628da120-482c-4875-aba4-3763ba29a46d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.325781 Dec 17 13:07:50.981227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1232/2460] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Dec 17 13:07:50 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:51.553304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:51.553940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:51.560192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:51.560639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:51.561862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:51.562547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:51.658228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:51.666830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77ab08d2-fcac-4e7f-9a83-44187cda3689 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.117685 Dec 17 13:07:51.667575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1229/2461] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:52.347348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1565210275", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad5a099b-4879-4e6b-97ab-1f857652d3ac"}], "security_groups": [{"name": "tempest-securitygroup--1565278349"}], "key_name": "tempest-keypair-1052580289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:07:52.452676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] validate_networks() for [('ad5a099b-4879-4e6b-97ab-1f857652d3ac', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:07:52.689324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:52.690163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:52.700682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:52.701491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:52.702551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:52.703433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:52.770922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:52.779522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0db96f01-5a16-4051-97dd-2f8c64c838b1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099406 Dec 17 13:07:52.780822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1230/2462] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:52.945319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:07:52.945730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:07:52.946210 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:07:52.946920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:07:52.947773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:07:52.957184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:52.957601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:52.958614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:52.959047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:52.976884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:07:52.981456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:07:52.992564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:07:52.994981 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:07:53.043084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6911cca0-1929-4c1f-848a-a46ea3d8cac1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700687 Dec 17 13:07:53.043991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1233/2463] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:07:52 2021] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:07:53.053611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-90a96dec-92d9-4c2e-ac4f-a1d7a57f0b1a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:53.054248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-90a96dec-92d9-4c2e-ac4f-a1d7a57f0b1a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:53.113190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-90a96dec-92d9-4c2e-ac4f-a1d7a57f0b1a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:53.121143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-90a96dec-92d9-4c2e-ac4f-a1d7a57f0b1a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1238 microversion: 2.1 time: 0.071092 Dec 17 13:07:53.121942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1231/2464] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:53 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:53.797578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:53.798190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:53.812578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:53.813075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:53.820203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:53.820680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:53.909260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:53.918050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68546f54-ee03-4ecd-931e-f671352c8047 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.125627 Dec 17 13:07:53.918695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1234/2465] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:54.140903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:54.141585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:54.149325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:54.150397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:54.151544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:54.152028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:54.219973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:54.228744 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a3618d0e-0c6b-4bcf-adea-7b14b18fdcb0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1290 microversion: 2.1 time: 0.093104 Dec 17 13:07:54.229911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1232/2466] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:54 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:54.935264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:54.935849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:54.943696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:54.944143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:54.944939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:54.945441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:55.019284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:55.028403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-56deb15e-b07c-448b-bf8f-6158b57a7c18 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096819 Dec 17 13:07:55.029324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1235/2467] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:55.249682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:55.250273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:55.256274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:55.256704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:55.257504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:55.257932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:55.384118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:55.391663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-80b0e2d4-ec4f-482c-a72b-9addd6f43011 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.146227 Dec 17 13:07:55.392568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1233/2468] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:55 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:55.622778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-fdedbf3f-0a97-4c03-a790-33b137f3dba0 req-9dedd6af-253a-4d08-9e7b-c889447b2448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b87a26d-6193-43d4-918a-92bb8c942c88", "tag": "269db193-f1d9-4700-81ea-793b7085b762"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:07:55.624766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:07:55.624766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:07:55.632211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-fdedbf3f-0a97-4c03-a790-33b137f3dba0 req-9dedd6af-253a-4d08-9e7b-c889447b2448 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:55.632989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-fdedbf3f-0a97-4c03-a790-33b137f3dba0 req-9dedd6af-253a-4d08-9e7b-c889447b2448 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:55.645633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-fdedbf3f-0a97-4c03-a790-33b137f3dba0 req-9dedd6af-253a-4d08-9e7b-c889447b2448 service nova] Creating event network-changed:269db193-f1d9-4700-81ea-793b7085b762 for instance 8b87a26d-6193-43d4-918a-92bb8c942c88 on hv-cinder-80152 Dec 17 13:07:55.650736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-fdedbf3f-0a97-4c03-a790-33b137f3dba0 req-9dedd6af-253a-4d08-9e7b-c889447b2448 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031666 Dec 17 13:07:55.652013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1236/2469] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:07:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:07:56.046991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:56.047612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:56.054120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:56.054541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:56.055331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:56.055799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:56.115895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:56.123945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b7a31d95-7817-46ba-b09e-2d32dc945896 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082376 Dec 17 13:07:56.124644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1234/2470] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:56.409248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:56.409927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:56.416751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:56.417200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:56.418086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:56.418520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:56.634986 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:56.646591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a4a473cb-b89e-42aa-8886-85745f151622 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.241793 Dec 17 13:07:56.647431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1237/2471] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:56 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:57.144818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:57.145863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:57.156950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:57.157784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:57.159061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:57.159775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:57.237551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:57.246831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4da0e484-1543-4f0c-8358-f71599165c7c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.108103 Dec 17 13:07:57.247489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1235/2472] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:57.669303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:57.669915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:57.676739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:57.677166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:57.677980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:57.678415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:57.814042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:57.822039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-24647d5c-8a4c-48e0-acea-f480b31e8ece tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.158729 Dec 17 13:07:57.822640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1238/2473] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:57 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:58.265976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:58.266735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:58.275127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:58.275709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:58.276705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:58.277253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:58.349026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:58.359284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e3f0ee1d-e427-44ba-a36b-b583f496149c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.098082 Dec 17 13:07:58.359851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1236/2474] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:58.839647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:58.840254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:58.846939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:58.847384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:58.848155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:58.848586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:58.994106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:59.002348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a3c3ba33-c4d1-4845-8b96-4504d0151d7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.166772 Dec 17 13:07:59.002912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1239/2475] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:58 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:07:59.379509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:07:59.380495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:07:59.390133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:59.390584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:59.391363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:07:59.391798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:07:59.450968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:07:59.459277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4a89721c-98c6-4dce-963f-6226a69ccf54 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085956 Dec 17 13:07:59.459926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1237/2476] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:07:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:00.019071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:00.019687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:00.026417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:00.026855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:00.027608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:00.028031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:00.162782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:00.172389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-910e3a72-1c84-43af-b43f-5d6d2ddae8d7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.156947 Dec 17 13:08:00.172954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1240/2477] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:00 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:00.480288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:00.481307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:00.492110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:00.492851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:00.494206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:00.494927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:00.556757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:00.565019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c630577b-e994-4d9d-b90b-38be0840b8a3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091101 Dec 17 13:08:00.565643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1238/2478] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:01.191313 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:01.192043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:01.200429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:01.200998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:01.202039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:01.202585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:01.349461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:01.359710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a4be7c8-8495-40bc-bc1d-5d059fa2972b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.173231 Dec 17 13:08:01.360294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1241/2479] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:01 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:01.582129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:01.582761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:01.589951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:01.590412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:01.591180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:01.591617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:01.651393 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:01.659810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9b854303-81fc-439e-ab56-34e422f843cc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081477 Dec 17 13:08:01.660395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1239/2480] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:01.939796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-0b174e64-9acd-4425-b58b-9926fb7e89fe req-3db47ab4-9414-4c65-ae04-be34c0ab237b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b87a26d-6193-43d4-918a-92bb8c942c88", "name": "network-vif-plugged", "status": "completed", "tag": "269db193-f1d9-4700-81ea-793b7085b762"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:01.941433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:08:01.941433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:08:01.949360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-0b174e64-9acd-4425-b58b-9926fb7e89fe req-3db47ab4-9414-4c65-ae04-be34c0ab237b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:01.949792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-0b174e64-9acd-4425-b58b-9926fb7e89fe req-3db47ab4-9414-4c65-ae04-be34c0ab237b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:01.961064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-0b174e64-9acd-4425-b58b-9926fb7e89fe req-3db47ab4-9414-4c65-ae04-be34c0ab237b service nova] Creating event network-vif-plugged:269db193-f1d9-4700-81ea-793b7085b762 for instance 8b87a26d-6193-43d4-918a-92bb8c942c88 on hv-cinder-80152 Dec 17 13:08:01.966680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-0b174e64-9acd-4425-b58b-9926fb7e89fe req-3db47ab4-9414-4c65-ae04-be34c0ab237b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086809 Dec 17 13:08:01.967443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1242/2481] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:08:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:08:02.380142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:02.381126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:02.391203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:02.391652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:02.392420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:02.392845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:02.538270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:02.546229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7bbad0e3-500e-4bb4-a955-3943afa9d936 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1364 microversion: 2.1 time: 0.172131 Dec 17 13:08:02.546793 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1240/2482] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:02 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:02.676550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:02.677242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:02.684184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:02.684638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:02.685487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:02.685925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:02.745880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:02.754206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1474caa3-fdc1-470e-b8aa-27b602e3ea02 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081754 Dec 17 13:08:02.754770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1243/2483] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:03.562870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:03.563485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:03.570618 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.571063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.571829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.572418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.706287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:03.714512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d2c0c8cb-8b78-4140-b8e3-2ad24e48941c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1550 microversion: 2.1 time: 0.155403 Dec 17 13:08:03.715062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1241/2484] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:03 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:03.730641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:03.731261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:03.738039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.738582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.739350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.739776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.771044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:03.771788 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:03.778867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.779325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.780132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:03.780535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:03.819158 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a5905b8c-1c30-4d6a-a5d2-b50afa3d429a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092125 Dec 17 13:08:03.820073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1244/2485] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Dec 17 13:08:03 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:08:03.841006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:03.849372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-59f4f99d-2cad-4a55-ae22-baabf1459fb0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082083 Dec 17 13:08:03.849964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1242/2486] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:04.866483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:04.867163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:04.873559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:04.874066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:04.874911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:04.875579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:04.983263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:04.992880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f8addaa6-62cb-46f8-a2b9-666154e5f017 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.130493 Dec 17 13:08:04.993482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1245/2487] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:05.085065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:05.086126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:05.090456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-460f2057-a1a8-476f-97c8-b37001f134d9 req-5723fc97-f686-4d10-805d-2bf4a3cdb2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b87a26d-6193-43d4-918a-92bb8c942c88", "tag": "269db193-f1d9-4700-81ea-793b7085b762"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:05.092021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:08:05.092021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:08:05.093369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:05.093918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:05.094965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:05.095497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:05.100304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-460f2057-a1a8-476f-97c8-b37001f134d9 req-5723fc97-f686-4d10-805d-2bf4a3cdb2ac service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:05.100304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-460f2057-a1a8-476f-97c8-b37001f134d9 req-5723fc97-f686-4d10-805d-2bf4a3cdb2ac service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:05.110532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-460f2057-a1a8-476f-97c8-b37001f134d9 req-5723fc97-f686-4d10-805d-2bf4a3cdb2ac service nova] Creating event network-changed:269db193-f1d9-4700-81ea-793b7085b762 for instance 8b87a26d-6193-43d4-918a-92bb8c942c88 on hv-cinder-80152 Dec 17 13:08:05.115736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-460f2057-a1a8-476f-97c8-b37001f134d9 req-5723fc97-f686-4d10-805d-2bf4a3cdb2ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029085 Dec 17 13:08:05.116393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1246/2488] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:08:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:08:05.156295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ad2c33ef-e3c2-45d4-aca3-dc8c95fef312 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.074833 Dec 17 13:08:05.157811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1243/2489] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:05 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:06.009951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:06.010647 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:06.017431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:06.017885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:06.018735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:06.019201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:06.082077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:06.091001 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3852b5cd-17ec-430e-a8c3-2c42960c7aee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085838 Dec 17 13:08:06.091574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1247/2490] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:06.168128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:06.169165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:06.177070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:06.177399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:06.178202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:06.178869 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:06.244126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f728f7db-15bc-4512-ad7d-6dc1dfb15376 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.079780 Dec 17 13:08:06.244666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1244/2491] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:06 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:07.111768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:07.112649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:07.123309 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:07.124050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:07.125324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:07.126136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:07.187735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:07.195661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aaefdf25-06ae-4bc4-879a-8fbd8c4250b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090201 Dec 17 13:08:07.196578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1248/2492] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:07.255651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:07.256652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:07.264062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:07.264553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:07.265410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:07.265828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:07.324198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6416ab8-1ae6-403e-9923-13415d531cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.072158 Dec 17 13:08:07.324938 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1245/2493] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:07 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:08.216176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:08.217105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:08.227737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:08.228526 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:08.229922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:08.230651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:08.297385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:08.309636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-49cda5f3-fdbc-4111-8f02-b19b9b2fbe8b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099831 Dec 17 13:08:08.310345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1249/2494] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:08.338372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:08.339504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:08.346798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:08.347250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:08.348035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:08.348461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:08.406277 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b001dec6-bb54-4d5e-82c5-28b803a48021 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.072292 Dec 17 13:08:08.406913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1246/2495] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:08 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:09.333720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:09.334659 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:09.345684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:09.346417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:09.347825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:09.348544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:09.408179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:09.416707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5eb2cc85-ba4d-4921-8f0e-358ce062d8ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089165 Dec 17 13:08:09.417254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1250/2496] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:09.418137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:09.419151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:09.426347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:09.426791 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:09.427608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:09.428077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:09.485175 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a40bfa0-a006-4d56-be2d-559980edfa32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.071112 Dec 17 13:08:09.485851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1247/2497] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:09 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:10.437416 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:10.438335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:10.449064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:10.449867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:10.451220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:10.451950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:10.496654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:10.497696 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:10.504587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:10.505038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:10.505845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:10.506278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:10.514895 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:10.523038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-407a539f-44f7-411c-91f4-f9205ce375a8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091964 Dec 17 13:08:10.523605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1251/2498] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:10.563073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f5e0abdd-b403-47cb-bd56-2f69c2c0eeed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.069932 Dec 17 13:08:10.563756 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1248/2499] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:10 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:11.543029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:11.543923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:11.554705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:11.555453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:11.556750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:11.557517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:11.574820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:11.575838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:11.582741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:11.583150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:11.583917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:11.584339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:11.625039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:11.635958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d4c4847a-0d2d-4834-9c28-6b1eaffc22c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099433 Dec 17 13:08:11.636520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1252/2500] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:11.644303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1ce58d3f-093b-4e5d-8f0e-0ac44abb13d4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.073335 Dec 17 13:08:11.644923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1249/2501] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:11 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:12.659665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:12.661197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:12.662010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:12.662219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:12.671850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:12.672587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:12.672913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:12.673576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:12.673888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:12.674598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:12.674883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:12.675531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:12.737076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:12.738337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8c8b370a-61dc-4022-a42e-4a7b37125fd3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.084997 Dec 17 13:08:12.741824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1250/2502] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:12 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:12.747628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4c424c84-d062-4b17-b57c-950c7de4acdc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092151 Dec 17 13:08:12.748419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1253/2503] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:13.752086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:13.753112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:13.762142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:13.762267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:13.762963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:13.763378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:13.767866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:13.768473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:13.775213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:13.775660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:13.776444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:13.776919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:13.831400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c7e61e60-20d4-4c3e-8b6a-08a117b62acd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.085132 Dec 17 13:08:13.834476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1251/2504] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:13 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:13.839302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:13.847386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9b03fef0-df1a-4dae-9e98-38fbf295b315 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083308 Dec 17 13:08:13.847984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1254/2505] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:14.844379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:14.845418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:14.852433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:14.852876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:14.853707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:14.854123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:14.869772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:14.870348 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:14.876842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:14.877315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:14.878090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:14.878517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:14.922835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fa78aa4d-72e3-4a9f-bf92-7c59e264ee1d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 14 microversion: 2.1 time: 0.082391 Dec 17 13:08:14.926068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1252/2506] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:14 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:08:14.937400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:14.945542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e7fa4c17-48a7-4808-a39c-e5b5c731dc40 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079667 Dec 17 13:08:14.946098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1255/2507] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:15.939561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:15.941151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:15.950894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:15.951341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:15.952131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:15.952561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:15.961716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:15.962510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:15.969840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:15.970378 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:15.971198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:15.971644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:16.022449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7307d346-a8d2-4368-a58e-0264fbb03545 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 11454 microversion: 2.1 time: 0.090312 Dec 17 13:08:16.022983 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1253/2508] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:15 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 11454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:16.030797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:16.038739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ae23b78c-64d0-44e7-8d11-a9af54b0277d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080706 Dec 17 13:08:16.039304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1256/2509] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:17.038551 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:17.040152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:17.051563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:17.052301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:17.053631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:17.054509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:17.058408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:17.059018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:17.065608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:17.066054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:17.066835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:17.067266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:17.128067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:17.136243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f3973a9-289a-4f25-9c96-dbe96f7c3d4c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083428 Dec 17 13:08:17.136825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1257/2510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:17.153882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd97a62c-4fef-4499-af23-54abebebde94 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 18498 microversion: 2.1 time: 0.121990 Dec 17 13:08:17.154554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1254/2511] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:17 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 18498 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:18.162116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:18.163051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:18.171456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:18.171908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:18.172410 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:18.172872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:18.173112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:18.173462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:18.180707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:18.181156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:18.181971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:18.182420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:18.237532 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:18.245948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fc66892b-ecb2-49af-ac0b-373710af3e43 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090199 Dec 17 13:08:18.246839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1258/2512] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:18.250385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d6d56538-9bf2-4825-9fc8-10c842d00eb7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 19133 microversion: 2.1 time: 0.081876 Dec 17 13:08:18.250995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1255/2513] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:18 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 19133 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:19.266103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:19.267036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:19.267673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:19.267893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:19.277120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:19.277623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:19.278119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:19.278407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:19.278564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:19.278831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:19.279458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:19.279908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:19.340148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:19.347542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a91d741f-49ad-46aa-883d-6ee788f8cda5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 21791 microversion: 2.1 time: 0.087776 Dec 17 13:08:19.348311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1259/2514] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:19 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 21791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:19.348491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-defb89e6-e9e9-4e18-b790-3e314ac62086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088631 Dec 17 13:08:19.349039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1256/2515] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:20.359950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:20.361198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:20.365001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:20.365654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:20.368494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:20.368941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:20.369771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:20.370199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:20.372621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:20.373065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:20.375071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:20.375071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:20.437060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:20.445427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d3afc71a-3552-4f73-92a9-3a836977f9a0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084035 Dec 17 13:08:20.445995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1257/2516] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:08:20.454136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3efa9cdd-d2e0-40da-b38b-50f3d055af95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 23235 microversion: 2.1 time: 0.098119 Dec 17 13:08:20.454870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1260/2517] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:20 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 23235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:21.462702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:21.463690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:21.468478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:21.469691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:21.470394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:21.470809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:21.471628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:21.472054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:21.477932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:21.478587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:21.479239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:21.479686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:21.535570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:21.543834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1fcb6a4f-3a9e-4840-bd1c-5230c3a5647d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084985 Dec 17 13:08:21.544439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1258/2518] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:21.553000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8e97078c-1210-4595-b24d-e7fd0c25503c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 24594 microversion: 2.1 time: 0.089557 Dec 17 13:08:21.553817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1261/2519] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:21 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 24594 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:22.564741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:22.565915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:22.568446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:22.570102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:22.576379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:22.576824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:22.577649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:22.578068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:22.579183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:22.579624 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:22.580381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:22.580799 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:22.639349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:22.648627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3ff11894-06b9-4f59-ab01-23bc2238efe4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089979 Dec 17 13:08:22.649197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1259/2520] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:22.650808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fa08fdbc-2b23-4a36-a8ba-95a9e8cf6992 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 26259 microversion: 2.1 time: 0.088845 Dec 17 13:08:22.651692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1262/2521] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:22 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 26259 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:23.666125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:23.667772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:23.670047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:23.671196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:23.678508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:23.679229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:23.680584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:23.681347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:23.682886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:23.683663 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:23.684955 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:23.685586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:23.748055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:23.756278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-07ada87d-15e8-489b-a10b-8bb944ea580b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 27534 microversion: 2.1 time: 0.096132 Dec 17 13:08:23.756913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1260/2522] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:23 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 27534 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:23.757085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dbca0112-5344-4f94-91ac-012aa75ee827 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093783 Dec 17 13:08:23.757543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1263/2523] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:24.773468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:24.775062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:24.776678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:24.777727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:24.785965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:24.786722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:24.787992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:24.788292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:24.788727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:24.789009 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:24.790222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:24.790945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:24.852028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:24.860385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a2fe30f3-82a7-4770-b3bb-fb6921d322dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089617 Dec 17 13:08:24.860948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1264/2524] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:24.886120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b8c9d8d5-3716-447d-9169-5ea5e1a3fc5c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 27931 microversion: 2.1 time: 0.119339 Dec 17 13:08:24.887018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1261/2525] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:24 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 27931 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:25.879660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:25.880801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:25.891371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:25.892110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:25.893385 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:25.894142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:25.902856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:25.904504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:25.911449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:25.911889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:25.912662 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:25.913082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:25.960319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:25.968759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-090c2f3e-a36a-4c03-9481-c0c714abdecd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095174 Dec 17 13:08:25.969320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1265/2526] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:25.985688 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-01475091-61b0-4abf-882c-36d6884a19a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.089673 Dec 17 13:08:25.986354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1262/2527] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:25 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:26.988472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:26.989181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:26.997458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:26.998027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:26.998994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:26.999536 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:26.999729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:27.000969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:27.009912 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:27.010383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:27.011343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:27.011880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:27.060864 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:27.069578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f048ecff-480d-409a-b43d-323ffa6e53c2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085929 Dec 17 13:08:27.070766 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1266/2528] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:27.074705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8e5de861-7e28-43bb-a7ea-cc61cd86e526 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.080168 Dec 17 13:08:27.075666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1263/2529] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:26 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:28.091710 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:28.092675 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:28.093406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:28.093624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:28.100063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:28.100528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:28.100691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:28.101099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:28.101266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:28.101741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:28.101887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:28.102345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:28.163775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:28.171587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5f075db-7d30-4b2c-96e3-070796493ff9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086221 Dec 17 13:08:28.172169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1264/2530] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:28.183336 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d5067aaa-dda8-4e9e-9429-3f98cb4baee3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.097912 Dec 17 13:08:28.184154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1267/2531] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:28 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:29.188207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:29.188941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:29.195713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:29.196411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:29.196737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:29.196935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:29.197689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:29.198118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:29.203922 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:29.204371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:29.205137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:29.205589 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:29.259895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:29.267409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92865d2b-3ca1-4877-9214-b127df0b2b73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.075562 Dec 17 13:08:29.267949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7ef12f47-3a79-439f-a519-2da5bb24402d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083627 Dec 17 13:08:29.268515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1268/2532] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:29 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:29.268659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1265/2533] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:30.283246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:30.284249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:30.284539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:30.285153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:30.291475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:30.291926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:30.292080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:30.292469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:30.292714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:30.293126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:30.293252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:30.293722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:30.354035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:30.358446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-11e18076-3d77-476e-a9d5-5d961bd8ed23 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.079876 Dec 17 13:08:30.359131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1269/2534] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:30 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:30.362227 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-afefd535-1d36-4306-9638-1700d8d34db1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081630 Dec 17 13:08:30.362789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1266/2535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:08:30.606155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:08:30.606567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:08:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:08:31.375541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:31.377148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:31.387085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:31.388206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:31.389742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:31.390722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:31.391668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:31.392310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:31.396082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:31.396530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:31.397349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:31.397817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:31.451639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4cd66ae1-c67b-4537-8564-eaa5c73327d6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.083599 Dec 17 13:08:31.452273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1270/2536] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:31 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:31.459822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:31.468878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e753c7a4-eac8-4e0a-be06-cc05b86d1844 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088374 Dec 17 13:08:31.469475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1267/2537] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:32.466938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:32.468193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:32.476345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:32.476795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:32.477619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:32.478049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:32.486452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:32.487071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:32.495653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:32.496337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:32.497575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:32.498245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:32.544257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4c08d163-f0ad-4cd2-99df-055f38a657f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.083593 Dec 17 13:08:32.544907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1271/2538] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:32 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:32.560397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:32.569316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5eda0b15-d886-485b-8298-8fa1381b8cab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087187 Dec 17 13:08:32.569891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1268/2539] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:33.560761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:33.562452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:33.573998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:33.574778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:33.576056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:33.576771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:33.586064 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:33.586672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:33.593725 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:33.594176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:33.595033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:33.595394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:33.637899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bd5761f4-aa05-4d3b-8fce-528e921a1eda tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.083466 Dec 17 13:08:33.638565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1272/2540] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:33 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:33.654895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:33.663014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2e0e22f-53c4-4e11-80fb-f4c5f00aab8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080572 Dec 17 13:08:33.663581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1269/2541] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:34.654580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:34.656330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:34.663732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:34.664176 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:34.664959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:34.665425 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:34.679495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:34.680056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:34.686908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:34.687411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:34.688302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:34.688803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:34.726213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e50d852b-ed71-4874-821b-07975ddf04a1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.078256 Dec 17 13:08:34.726889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1273/2542] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:34 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:34.750299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:34.758829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a4a3688-f380-4aaa-9ade-fe83aa035dea tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082964 Dec 17 13:08:34.759406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1270/2543] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:35.742850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:35.744529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:35.754155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:35.754655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:35.755513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:35.755998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:35.822530 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-57f598bb-0e03-40bd-8e04-5791a960b69d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.086392 Dec 17 13:08:35.826884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1274/2544] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:35 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:35.898325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:35.898930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:35.905464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:35.905905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:35.906704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:35.907153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:35.971667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:35.979548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-01b9ce2b-8ebd-4461-b647-959c804e07c3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.207628 Dec 17 13:08:35.980104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1271/2545] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:36.835787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:36.836798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:36.845936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:36.846388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:36.847171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:36.847606 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:36.908485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-14c80e4a-f48e-46a0-8a08-4f118240588a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.076514 Dec 17 13:08:36.909444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1275/2546] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:36 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:36.997258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:36.997986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:37.006111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:37.006564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:37.007366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:37.007801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:37.070071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:37.078143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8aa7cfda-0dc8-499a-ac1d-207c05bf14b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085247 Dec 17 13:08:37.078824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1272/2547] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:37.925105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:37.926804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:37.938076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:37.938565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:37.939302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:37.939733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:37.998658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f70dbdf1-a651-40aa-b24c-ae4680098557 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28227 microversion: 2.1 time: 0.080292 Dec 17 13:08:37.999273 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1276/2548] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:37 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28227 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:38.099111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:38.099940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:38.110147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:38.110603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:38.111379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:38.111814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:38.175123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:38.186841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e42b0950-b3f0-4649-9ad5-959be69b34ab tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093713 Dec 17 13:08:38.187685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1273/2549] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:39.015915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:39.017013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:39.025405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:39.025932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:39.026839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:39.027347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:39.105510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-19eeb582-aa08-4385-826c-d9ff1fd77c91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28518 microversion: 2.1 time: 0.096424 Dec 17 13:08:39.106054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1277/2550] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:39 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28518 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:39.209416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:39.210301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:39.219218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:39.219663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:39.220439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:39.220877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:39.290335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:39.298221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c13835e7-1fa0-449b-ba9f-b5418bd12a6b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093455 Dec 17 13:08:39.298760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1274/2551] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:40.121902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:40.123398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:40.131201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:40.131643 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:40.132421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:40.132850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:40.208382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c526cc3c-09c7-4273-961f-9a745edd9c74 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.093369 Dec 17 13:08:40.209022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1278/2552] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:40 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 13:08:40.322156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:40.323149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:40.331895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:40.332360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:40.333105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:40.333561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:40.394666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:40.402964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1b9628a0-cf03-4639-9f78-f695d45bcadd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086957 Dec 17 13:08:40.403532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1275/2553] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:41.225625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:41.227157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:41.237253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:41.237738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:41.238523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:41.238962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:41.299894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8ae44521-d36e-4a0c-b3f3-8294409155d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.081054 Dec 17 13:08:41.300720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1279/2554] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:41 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:41.422351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:41.423031 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:41.433044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:41.433885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:41.435148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:41.435844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:41.497881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:41.506273 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-681bffb4-28d2-4153-b43d-5faebc3c5a15 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089934 Dec 17 13:08:41.506838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1276/2555] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:42.319345 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:42.320951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:42.332456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:42.333194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:42.334520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:42.335207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:42.399290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-05b56395-2b57-485a-b51e-71d2f24d1fba tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.086980 Dec 17 13:08:42.399929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1280/2556] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:42 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:42.526616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:42.527701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:42.536022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:42.536475 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:42.537255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:42.537782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:42.601324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:42.609843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-26788374-f6d6-4acd-b31b-efa25d38724c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089452 Dec 17 13:08:42.610404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1277/2557] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:43.416223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:43.417879 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:43.426727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:43.427167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:43.427950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:43.428390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:43.490804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c553f6e9-40df-4ef3-a387-495a38360f7e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.080930 Dec 17 13:08:43.491706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1281/2558] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:43 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:43.629784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:43.630743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:43.641577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:43.642019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:43.642810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:43.643235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:43.701658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:43.710238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dffd5a78-5924-427f-a0cd-1971d68b805b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086792 Dec 17 13:08:43.710817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1278/2559] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:44.509188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:44.510831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:44.522514 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:44.523258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:44.524552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:44.525271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:44.593240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-23c1ec3c-9d6c-4af8-a917-5e107edf12e7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.090761 Dec 17 13:08:44.593916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1282/2560] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:44 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:44.734879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:44.735804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:44.746972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:44.747833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:44.749102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:44.750081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:44.815109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:44.823106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-350ce423-8089-4e74-b17a-60a3ca128c11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094835 Dec 17 13:08:44.823664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1279/2561] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:45.609046 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:45.610520 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:45.617777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:45.618239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:45.619012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:45.619450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:45.679655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d04bd650-d626-49f1-8fa8-123c694dd344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.077333 Dec 17 13:08:45.680282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1283/2562] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:45 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:45.840387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:45.840988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:45.847868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:45.848309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:45.849075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:45.849545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:45.908987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:45.917625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2a78f6dc-6975-43a4-87c7-d0c047c71dfc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081226 Dec 17 13:08:45.918196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1280/2563] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:46.696508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:46.698189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:46.709719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:46.710457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:46.711723 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:46.712426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:46.777584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-48177d2a-6705-4678-80e3-7da659288537 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.087807 Dec 17 13:08:46.778208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1284/2564] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:46 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:46.938486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:46.939080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:46.945798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:46.946237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:46.947068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:46.947425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:47.006978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:47.014783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd5f2ae1-d5a4-47dd-b150-b6d19294a00f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082336 Dec 17 13:08:47.015344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1281/2565] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:47.794199 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:47.795814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:47.803840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:47.804287 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:47.805068 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:47.805546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:47.864568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66e55820-45e1-4499-8237-988f137e871f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.077099 Dec 17 13:08:47.865219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1285/2566] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:47 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:48.035339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:48.036203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:48.046946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:48.047649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:48.048416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:48.048841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:48.119386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:48.127305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8def777b-5f18-4765-9b0e-15ca45b7ec0b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.098331 Dec 17 13:08:48.127862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1282/2567] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:48.879050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:48.880357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:48.890240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:48.890842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:48.891802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:48.892230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:48.952949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4f4d057a-1a17-4888-8be1-33f184856e36 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.079305 Dec 17 13:08:48.953635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1286/2568] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:48 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:49.147850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:49.148713 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:49.158480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:49.158922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:49.159685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:49.160110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:49.229030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:49.237287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-43f9cc9d-9ca5-499c-9941-7e9e01d38cc0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095789 Dec 17 13:08:49.237902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1283/2569] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:49.970028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:49.971256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:49.979933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:49.980462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:49.981413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:49.981924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:50.050694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f6519bb-e0a5-4304-959a-931b94f3bc50 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.087583 Dec 17 13:08:50.051251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1287/2570] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:49 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:50.254459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:50.255052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:50.263575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:50.264183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:50.265327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:50.265890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:50.323780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:50.331866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-287a1310-0992-49f5-8723-69002f87034f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081190 Dec 17 13:08:50.332438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1284/2571] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:51.067311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:51.068936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:51.080079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:51.080456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:51.081296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:51.081731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:51.143318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-acabf0de-e31b-4b20-a836-ca70183f6257 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.082647 Dec 17 13:08:51.143949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1288/2572] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:51 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:51.351222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:51.351808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:51.359522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:51.359962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:51.360731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:51.361157 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:51.427964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:51.435996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c170462-88f6-4e0c-b010-785c37375e3b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091060 Dec 17 13:08:51.436553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1285/2573] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:52.159182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:52.160440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:52.170042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:52.170726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:52.171648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:52.172108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:52.232189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7e845c99-e526-4fa8-9a82-a698f9296370 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.079870 Dec 17 13:08:52.232836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1289/2574] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:52 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:52.456834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:52.458063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:52.468476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:52.468924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:52.469746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:52.470179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:52.541048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:52.553248 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e6b1bff1-8682-432b-92a6-e15623dea7b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.102575 Dec 17 13:08:52.554006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1286/2575] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:53.244795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:53.245722 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:53.253135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:53.253612 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:53.254384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:53.254807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:53.343816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d806e621-ea47-4910-a154-56a3c81db86a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.103020 Dec 17 13:08:53.344478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1290/2576] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:53 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:53.570104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:53.570707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:53.577889 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:53.578339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:53.579142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:53.579595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:53.652434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:53.660851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-109a6f6d-7a2c-406b-a57f-df46a27acbae tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094594 Dec 17 13:08:53.661458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1287/2577] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:54.362584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:54.364259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:54.375625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:54.376365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:54.377726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:54.378455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:54.450058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2a28e7c9-49ed-4300-bee5-a1004aa761dd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.094318 Dec 17 13:08:54.450688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1291/2578] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:54 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:54.681689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:54.682560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:54.690625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:54.691074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:54.691853 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:54.692281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:54.751863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:54.760041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c0d7464-88fa-48cb-b013-d21262a517c9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085122 Dec 17 13:08:54.760608 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1288/2579] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:55.467185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:55.468537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:55.476870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:55.477463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:55.478335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:55.478839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:55.542395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-671403d6-5ee0-4862-87fc-5152ff3e95e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.082371 Dec 17 13:08:55.543248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1292/2580] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:55 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:55.780847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:55.781822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:55.792478 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:55.793229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:55.794559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:55.795268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:56.013916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:56.025414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f596a3b1-2edb-4eca-af20-00863990df5f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.250374 Dec 17 13:08:56.026365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1289/2581] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:56.558702 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:56.560356 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:56.571831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:56.572570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:56.573914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:56.574619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:56.635794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-84e6885a-da36-42e9-81ed-3ba3452a2a0c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.083915 Dec 17 13:08:56.636464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1293/2582] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:56 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:57.052714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:57.053715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:57.063650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:57.064097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:57.064872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:57.065370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:57.123416 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:57.131411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5450e81f-c1f2-4b1a-a7e6-c2fae8c7501d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085061 Dec 17 13:08:57.131961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1290/2583] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:57.652461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:57.654116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:57.662255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:57.662696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:57.663464 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:57.663890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:57.728386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-887467d2-d4a2-4ab5-90bf-cef9468fca91 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.082344 Dec 17 13:08:57.729439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1294/2584] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:57 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:58.151262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:58.152196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:58.162038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:58.162757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:58.164016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:58.164661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:58.229431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:58.237442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4b834088-e45e-4998-9821-a91f4bcbdfa0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092402 Dec 17 13:08:58.237998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1291/2585] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:58.747940 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:58.749601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:58.761235 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:58.761998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:58.763266 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:58.763972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:58.829230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afee7f88-95d2-46b3-a4a1-1e16d999c015 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.087703 Dec 17 13:08:58.829913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1295/2586] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:58 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:08:59.255760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:08:59.256408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:59.264392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:59.264915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:59.265887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:59.266427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:59.327770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:08:59.335741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9bf5c0ba-d6cd-4bf7-9467-bda24d3ea49c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084440 Dec 17 13:08:59.336309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1292/2587] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:08:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:08:59.841268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:08:59.842297 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:08:59.849419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:59.849857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:59.850633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:08:59.851053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:08:59.917730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0f15d570-f969-4720-82d2-84dade2a23eb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.080878 Dec 17 13:08:59.918334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1296/2588] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:08:59 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:00.355015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:00.355663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:00.363717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:00.364168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:00.364948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:00.365418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:00.423236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:00.431180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7917865a-e018-41f2-b6e6-8334dbf2207d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081601 Dec 17 13:09:00.431761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1293/2589] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:00.932637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:00.934047 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:00.941678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:00.942124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:00.942897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:00.943320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:01.007753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0c9a3067-7efb-47dd-bb56-2bee618c844e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.080727 Dec 17 13:09:01.008352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1297/2590] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:00 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:01.447594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:01.448242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:01.454980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:01.455434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:01.456216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:01.456643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:01.515258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:01.522949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce4a7b43-70d6-4143-874a-e8107064b279 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079281 Dec 17 13:09:01.523506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1294/2591] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:02.024713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:02.026373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:02.037877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:02.038619 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:02.040019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:02.040630 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:02.102721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-387f542d-f17e-47be-b0ce-8812e40490d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.084747 Dec 17 13:09:02.103337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1298/2592] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:02 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:02.543790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:02.544830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:02.552769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:02.553228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:02.554046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:02.554500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:02.618503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:02.630154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7830b7c8-6e0f-4a34-be88-17431f22f5aa tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092346 Dec 17 13:09:02.630773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1295/2593] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:03.119892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:03.121443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:03.130562 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:03.131007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:03.131771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:03.132196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:03.191296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5fdfd8df-4127-4eab-ac03-bbb877c6ee39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.078384 Dec 17 13:09:03.191933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1299/2594] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:03 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:03.653119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:03.654112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:03.662754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:03.663311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:03.664254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:03.664778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:03.736333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:03.748882 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8155ce5d-76b9-449a-8748-b3c1ad5a41b6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.101589 Dec 17 13:09:03.749731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1296/2595] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:04.206832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:04.208049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:04.217142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:04.217738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:04.218695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:04.219233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:04.284644 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bb6d195e-60fe-4fb7-beb1-58c3e08bfe10 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.083735 Dec 17 13:09:04.285436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1300/2596] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:04 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:04.770067 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:04.771115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:04.781699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:04.782442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:04.783847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:04.784575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:04.851766 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:04.859775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3f06d8fa-3a08-4506-b97b-78fe9dfd3c22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096010 Dec 17 13:09:04.860334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1297/2597] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:05.301073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:05.302737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:05.314214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:05.314662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:05.315439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:05.315876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:05.374372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ab315c4a-dc9f-4416-bb73-15f50b250a76 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.080041 Dec 17 13:09:05.375005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1301/2598] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:05 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:05.877306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:05.878112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:05.886727 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:05.887327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:05.888356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:05.888930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:05.953269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:05.961267 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ddf2f25-5057-49a1-a794-50690a631c05 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087981 Dec 17 13:09:05.961831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1298/2599] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:06.390350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:06.391977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:06.399308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:06.399736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:06.400512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:06.400941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:06.465841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d9c747da-b9e7-465e-b540-f8a0ba8f3d73 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.081517 Dec 17 13:09:06.466672 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1302/2600] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:06 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:06.981338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:06.981963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:06.990403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:06.990850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:06.991631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:06.992061 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:07.060330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:07.068190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-947a0787-d198-456b-b9f4-b08572906145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092987 Dec 17 13:09:07.068926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1299/2601] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:07.482614 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:07.484222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:07.495558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:07.496298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:07.497753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:07.498472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:07.559432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-efee24dc-a20f-49bf-bf0b-90d2a4426656 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.083604 Dec 17 13:09:07.560082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1303/2602] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:07 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:08.089270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:08.090183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:08.098740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:08.099176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:08.099953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:08.100383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:08.159903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:08.167841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-efbe96f8-5b45-4158-8974-dbdb6e54cbd8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085246 Dec 17 13:09:08.168385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1300/2603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:08.577048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:08.578829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:08.586795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:08.587248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:08.588028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:08.588461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:08.647817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f0103390-1c87-4e71-9b02-0f2e7d38c0bf tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 28686 microversion: 2.1 time: 0.078055 Dec 17 13:09:08.648521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1304/2604] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:08 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 28686 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:09.187878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:09.188864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:09.199424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:09.200162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:09.201470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:09.202183 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:09.263411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:09.272482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f270ccc7-b8b0-438d-8cb3-d3c6c1f80785 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090802 Dec 17 13:09:09.273045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1301/2605] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:09.663003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:09.664010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:09.671292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:09.671743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:09.672517 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:09.672944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:09.747137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e114f8a9-1f07-4637-9818-285a0af2870c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 30635 microversion: 2.1 time: 0.088027 Dec 17 13:09:09.747851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1305/2606] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:09 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 30635 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:10.291215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:10.292032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:10.300363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:10.300816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:10.301631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:10.302072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:10.361949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:10.376526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f9157c6-c7dc-4c79-8c65-b4870bb98c21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090247 Dec 17 13:09:10.377109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1302/2607] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:10.761965 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:10.762867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:10.770296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:10.770743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:10.771522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:10.771952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:10.842246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3519a783-1194-4afc-af58-acecb297ead1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 32706 microversion: 2.1 time: 0.084406 Dec 17 13:09:10.842923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1306/2608] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:10 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 32706 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:11.397145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:11.398236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:11.409593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:11.410048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:11.410834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:11.411275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:11.479915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:11.488144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20aa9234-4937-4ed4-9cbd-f5ec26cab398 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097122 Dec 17 13:09:11.488704 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1303/2609] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:11.857587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:11.858790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:11.869357 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:11.870016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:11.871076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:11.871648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:11.943730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9448a5b0-2530-4156-8e04-647c8eb74579 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 33758 microversion: 2.1 time: 0.092194 Dec 17 13:09:11.944662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1307/2610] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:11 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 33758 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:12.508715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:12.509687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:12.519687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:12.520138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:12.520917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:12.521402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:12.584933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:12.593392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cc1be347-5928-48ec-a1ad-b72f04f3a24b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090669 Dec 17 13:09:12.593934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1304/2611] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:12.962183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:12.963789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:12.975638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:12.976372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:12.977690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:12.978410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:13.057451 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bea20ebf-f1b9-4acd-a82f-cdc5fa5290be tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 35075 microversion: 2.1 time: 0.101668 Dec 17 13:09:13.058447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1308/2612] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:12 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 35075 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:13.613879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:13.614814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:13.625519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:13.626280 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:13.627396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:13.627843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:13.688527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:13.699845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da3b80ae-2b5a-4c9c-aa16-c07b00d9ba1a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092128 Dec 17 13:09:13.700624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1305/2613] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:14.076725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:14.078386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:14.090442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:14.091188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:14.092475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:14.093198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:14.332979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a835b98-2d2c-4bb3-b2a8-94b0c2b76e80 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 36709 microversion: 2.1 time: 0.262313 Dec 17 13:09:14.333929 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1309/2614] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:14 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 36709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:14.719035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:14.719621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:14.727672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:14.728280 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:14.729314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:14.729956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:14.797214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:14.805585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cf303b0a-b497-4b3d-b635-b3897d738486 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090318 Dec 17 13:09:14.806179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1306/2615] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:15.352894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:15.354579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:15.365988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:15.366439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:15.367211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:15.367673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:15.437818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f00d08cd-07d5-4a41-b08f-69f108f9ac04 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38221 microversion: 2.1 time: 0.091867 Dec 17 13:09:15.438462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1310/2616] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:15 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:15.823668 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:15.824381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:15.832309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:15.832738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:15.833786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:15.834257 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:15.901715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:15.913848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b6450c7-66bb-4e70-bd89-eb24f9de8dba tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094129 Dec 17 13:09:15.914645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1307/2617] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:16.455111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:16.456750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:16.468693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:16.469500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:16.470853 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:16.471571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:16.536867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-67ebb7cc-29dc-4816-b566-f92f6dfc4755 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38221 microversion: 2.1 time: 0.088179 Dec 17 13:09:16.537688 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1311/2618] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:16 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:16.932381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:16.933080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:16.942930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:16.943522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:16.944507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:16.945082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:17.010612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:17.019297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b9981a29-9fae-472d-a5d9-40d4a5503f7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091866 Dec 17 13:09:17.019909 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1308/2619] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:17.554837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:17.556007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:17.565635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:17.566201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:17.567198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:17.567741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:17.638509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-37c3c051-729b-4c06-a911-aa0da5f1a549 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38221 microversion: 2.1 time: 0.090487 Dec 17 13:09:17.639127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1312/2620] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:17 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:18.040101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:18.041066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:18.051525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:18.052265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:18.053588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:18.054424 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:18.130348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:18.142427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a3afe52c-1e65-40e3-8970-013e324e8d0d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.108308 Dec 17 13:09:18.143260 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1309/2621] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:18.655999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:18.657801 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:18.667742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:18.668187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:18.668964 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:18.669442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:18.734443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d5b3d3ec-5488-4623-b41b-f1582b618645 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38221 microversion: 2.1 time: 0.085330 Dec 17 13:09:18.735123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1313/2622] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:18 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:19.163051 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:19.164072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:19.171498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:19.171943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:19.172711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:19.173145 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:19.241847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:19.253900 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-39f9fe88-62ab-4187-82ee-ff7656cf050f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096762 Dec 17 13:09:19.254748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1310/2623] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:19.755067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:19.756675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:19.768195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:19.768949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:19.770274 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:19.770996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:19.851958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-250e280a-5baa-475e-8ef5-4b5fe27cdf53 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38345 microversion: 2.1 time: 0.106096 Dec 17 13:09:19.852777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1314/2624] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:19 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:20.274203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:20.274865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:20.281312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.281781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:20.282549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.282979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:20.344149 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:20.352317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ac87c97a-3a7e-4c38-9f13-7a9d90ca76ef tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083395 Dec 17 13:09:20.352885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1311/2625] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:20.871020 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:09:20.872316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:20.882889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.883352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:20.884116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.884546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:20.967132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6497148c-ff54-4529-a23c-83f19d23c8af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 200 len: 38352 microversion: 2.1 time: 0.101914 Dec 17 13:09:20.968124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1315/2626] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:09:20 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 38352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:09:20.981517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:20.982002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:20.988334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.988777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:20.989585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:20.990013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:21.013264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ca138348-87d0-45be-8e81-d608af8e5926 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/ips" status: 200 len: 145 microversion: 2.1 time: 0.035444 Dec 17 13:09:21.013832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1312/2627] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Dec 17 13:09:20 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:09:21.372000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:21.373218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:21.385023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:21.385814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:21.387116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:21.387865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:21.450852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:21.459656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-db1938ec-c775-48bd-80fa-268c5ee31b21 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094656 Dec 17 13:09:21.460195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1316/2628] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:22.481226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:22.482526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:22.489160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:22.489637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:22.490388 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:22.490811 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:22.548906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:22.557185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ebceaca8-815a-4b74-b93a-eaa988360330 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079850 Dec 17 13:09:22.557792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1313/2629] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:23.574082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:23.574731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:23.581340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:23.581818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:23.582604 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:23.583032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:23.657178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:23.667671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c9ebc19a-188b-43bd-a993-bfaf07a634d4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097361 Dec 17 13:09:23.668240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1317/2630] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:24.685463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:24.686126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:24.693044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:24.693523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:24.694296 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:24.694731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:24.757214 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:24.765540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-723411b7-79ec-4f22-b90e-ab5c22a61305 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083835 Dec 17 13:09:24.766113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1314/2631] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:25.785545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:25.786502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:25.797638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:25.798379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:25.799674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:25.800392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:25.864883 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:25.873314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2388d817-b91b-4ed1-8e31-1a6918a877fe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094021 Dec 17 13:09:25.873909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1318/2632] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:26.893930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:26.894861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:26.904331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:26.904779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:26.905589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:26.906099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:26.969160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:26.977120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c1e72ed-1734-43d2-bb17-97c01dc3774f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089442 Dec 17 13:09:26.977720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1315/2633] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:27.994124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:27.994762 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:28.001941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:28.002399 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:28.003218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:28.003656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:28.066229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:28.075202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-86bc4e7d-d5b2-411a-b4ef-b783fb16527c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084697 Dec 17 13:09:28.075783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1319/2634] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:29.092810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:29.093422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:29.100092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:29.100540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:29.101309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:29.101773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:29.165726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:29.174060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ce2e1734-8205-4c84-aaed-aabc563a868e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085448 Dec 17 13:09:29.174638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1316/2635] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:30.191112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:30.191748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:30.198322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:30.198768 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:30.199669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:30.200101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:30.261661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:30.269742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-565c4f1f-2f39-4244-9f43-be6ad3c4d4c8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082364 Dec 17 13:09:30.270325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1320/2636] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:31.286904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:31.287528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:31.294599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:31.295052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:31.295832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:31.296270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:31.354450 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:31.362276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4c52e886-d0f9-4c8d-8451-2a8080a86a6d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079149 Dec 17 13:09:31.362842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1317/2637] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:32.383185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:32.384457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:32.392635 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:32.393152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:32.394184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:32.394621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:32.462617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:32.471559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-60ef9dd8-2613-4711-893d-e855d46b9d22 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094710 Dec 17 13:09:32.472121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1321/2638] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:33.492176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:33.493156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:33.501262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:33.501743 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:33.502517 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:33.502947 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:33.561098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:33.569025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd66ad8e-fc32-43c7-847c-208952eda737 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083021 Dec 17 13:09:33.569626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1318/2639] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:34.589060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:34.590490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:34.601106 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:34.602156 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:34.603250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:34.603962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:34.667328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:34.675320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cdeaca26-650d-424c-8c6f-de59f4f7f153 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092427 Dec 17 13:09:34.675882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1322/2640] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:35.700103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:35.701107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:35.711841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:35.712586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:35.713927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:35.715007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:35.772361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:35.780386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-546f7dee-26cb-4763-87fa-44876fc4e65d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086372 Dec 17 13:09:35.780950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1319/2641] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:36.801012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:36.802015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:36.813051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:36.813861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:36.815151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:36.815880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:36.877628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:36.885785 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a901bfa8-fcbd-4aff-9f95-3ecd0ea392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090939 Dec 17 13:09:36.886318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1323/2642] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:37.906346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:37.907514 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:37.918357 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:37.919106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:37.920405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:37.921127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:37.986435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:37.995150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-288e53bf-f38a-45c4-aad8-7bc8709eea11 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095065 Dec 17 13:09:37.995701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1320/2643] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:39.014413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:39.015034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:39.021913 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:39.022364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:39.023147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:39.023584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:39.091236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:39.100172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cbaac7c3-4361-4d7b-a431-7009aa107e7d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090912 Dec 17 13:09:39.100797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1324/2644] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:40.119052 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:40.119628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:40.126440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:40.126895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:40.127674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:40.128110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:40.196213 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:40.204402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bf2309c9-2327-4035-81e0-9dfea8a15cda tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089189 Dec 17 13:09:40.204967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1321/2645] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:41.225817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:41.226730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:41.237765 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:41.238572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:41.239380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:41.239813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:41.309797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:41.318124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e44d491b-ba32-44fe-8136-eea574f310ed tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.098892 Dec 17 13:09:41.318697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1325/2646] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:42.339940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:42.340574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:42.347033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:42.347486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:42.348323 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:42.348759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:42.413604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:42.422142 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8036937b-a6ab-4bcc-97d7-819d1390ec7b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086287 Dec 17 13:09:42.422755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1322/2647] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:43.444002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:43.444938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:43.455484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:43.456228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:43.457553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:43.457996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:43.518919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:43.527564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1a876a19-5e4b-44f0-8c7e-c45c4717bbc9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089654 Dec 17 13:09:43.528131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1326/2648] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:44.548203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:44.549140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:44.559813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:44.560563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:44.561943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:44.562666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:44.623042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:44.630972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff3f793a-7a76-467a-98f0-e58404c81db6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088968 Dec 17 13:09:44.631536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1323/2649] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:45.650220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:45.650942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:45.659152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:45.659674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:45.660662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:45.661250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:45.721669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:45.729875 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6db30cf8-7d35-4eae-89c0-535722f26326 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084195 Dec 17 13:09:45.730435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1327/2650] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:46.747015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:46.747685 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:46.754659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:46.755113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:46.755898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:46.756331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:46.815312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:46.823946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2dc5ea05-c42a-461a-a478-0326719c8fa2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.080685 Dec 17 13:09:46.824746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1324/2651] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:47.844257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:47.844865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:47.851476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:47.851930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:47.852704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:47.853128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:47.918119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:47.926217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-95aedce9-d748-4077-a735-2d138be18ed1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085653 Dec 17 13:09:47.926778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1328/2652] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:48.944922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:48.945610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:48.952571 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:48.953010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:48.953818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:48.954244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:49.023202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:49.031805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f16ea43-7cbf-43c1-9c63-44d3c752935d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091891 Dec 17 13:09:49.032439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1325/2653] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:50.052108 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:50.052671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:50.060220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:50.060703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:50.061597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:50.062035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:50.122550 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:50.130909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f4638615-4f12-47a2-b489-72e3ce4da5fb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084579 Dec 17 13:09:50.131472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1329/2654] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:51.151338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:51.152223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:51.162654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:51.163131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:51.163915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:51.164341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:51.232851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:51.244421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38243890-8271-4374-9ebd-13eb6301cef3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099050 Dec 17 13:09:51.245122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1326/2655] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:52.265793 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:52.266685 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:52.275599 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:52.276055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:52.276841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:52.277317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:52.336268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:52.344935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b973f82b-a501-4d83-b77e-5ee4a5968644 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085713 Dec 17 13:09:52.345543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1330/2656] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:52 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:53.361763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:53.362402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:53.368956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:53.369435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:53.370203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:53.370637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:53.432371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:53.440664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a85b73f6-dc47-46cc-bf06-32e07d3be3a5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.082641 Dec 17 13:09:53.441257 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1327/2657] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:54.461075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:54.461903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:54.470876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:54.471332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:54.472911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:54.473373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:54.540736 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:54.548608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-870cc627-dd93-49e6-a533-3d6e388c48b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093770 Dec 17 13:09:54.549172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1331/2658] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:55.571381 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:55.572156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:55.580433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:55.580991 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:55.581994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:55.582528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:55.655168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:55.666469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-55e949cb-9ef3-45c3-af80-48ec554efedd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.101380 Dec 17 13:09:55.667050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1328/2659] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:56.684620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:56.685237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:56.691980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:56.692431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:56.693217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:56.693681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:56.753572 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:56.762409 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5df3c91d-e88f-48a2-ac76-76a95909467c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081555 Dec 17 13:09:56.763028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1332/2660] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:57.784359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:57.785429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:57.794135 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:57.794576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:57.795340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:57.795769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:57.860476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:57.868612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-595e6302-846b-4edb-bd42-7b8e42d8aed8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091082 Dec 17 13:09:57.869187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1329/2661] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:58.888889 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:58.889873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:09:58.900781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:58.901220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:58.902035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:09:58.902459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:09:58.970802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:09:58.979341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bab15893-586f-4871-b364-547711c5c3e4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096652 Dec 17 13:09:58.979905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1333/2662] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:09:59.998184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:09:59.998758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:00.005530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:00.005978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:00.006767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:00.007202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:00.067017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:00.075195 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-05a04d7a-eba3-4cf7-9273-15db4d7526b7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081066 Dec 17 13:10:00.075689 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1330/2663] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:09:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:01.096303 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:01.097197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:01.106555 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:01.107006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:01.107787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:01.108220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:01.175374 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:01.187308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-17df8efe-21ec-4d48-835c-f1d53a383871 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097308 Dec 17 13:10:01.188119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1334/2664] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:02.213543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:02.214217 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:02.222745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:02.223295 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:02.224250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:02.224783 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:02.289262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:02.297120 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e88d639d-f7ce-49ce-99d7-72b77fe3a504 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090052 Dec 17 13:10:02.297737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1331/2665] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:02 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:03.317742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:03.318737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:03.327739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:03.328197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:03.328972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:03.329462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:03.388608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:03.397206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a98e0c57-9941-44cb-a357-f17a765d938f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085734 Dec 17 13:10:03.397809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1335/2666] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:04.417691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:04.418837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:04.429579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:04.430335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:04.431631 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:04.432366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:04.498118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:04.506687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-12107308-d091-43a9-82ff-de8c4043b81a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095142 Dec 17 13:10:04.507263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1332/2667] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:05.527651 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:05.528616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:05.535689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:05.536159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:05.536943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:05.537423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:05.604247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:05.612117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5a8e0996-4f58-4a95-8b80-8552ba93d43d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090735 Dec 17 13:10:05.612698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1336/2668] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:05.949368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:10:05.950363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:10:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:10:06.632874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:06.634261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:06.645596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:06.646375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:06.647638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:06.648347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:06.710048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:06.718544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-76c1272b-e217-4037-b046-d887e6a56de2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091946 Dec 17 13:10:06.719105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1333/2669] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:07.739162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:07.740371 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:07.750861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:07.751605 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:07.752884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:07.753660 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:07.822699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:07.831091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aa91f40f-44e1-40de-ba16-4123e6fc4431 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.098069 Dec 17 13:10:07.831645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1337/2670] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:08.847907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:08.848477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:08.855333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:08.855782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:08.856560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:08.856997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:08.919861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:08.927840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-44138469-42ad-45c6-b2dd-589d9dde0b27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083666 Dec 17 13:10:08.928396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1334/2671] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:09.945096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:09.945778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:09.952502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:09.952952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:09.953787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:09.954217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:10.017742 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:10.029657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3103b1a8-df11-452f-b7c4-d9dca3cf09b5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088240 Dec 17 13:10:10.030227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1338/2672] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:11.050174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:11.051096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:11.062215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:11.062652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:11.063429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:11.063852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:11.123243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:11.131505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c467c7cd-395d-4098-a5ef-a4d0d7e0f4db tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087517 Dec 17 13:10:11.132110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1335/2673] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:12.148220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:12.148829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:12.155646 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:12.156082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:12.156855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:12.157308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:12.216035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:12.224162 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba62445b-17b5-42b8-9774-140e11226b65 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079810 Dec 17 13:10:12.224714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1339/2674] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:13.245022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:13.245978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:13.254138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:13.254587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:13.255380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:13.255814 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:13.322516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:13.330968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-daac359d-2dc9-41bc-a8f0-e092604f7c49 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092261 Dec 17 13:10:13.331546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1336/2675] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:13 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:14.355558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:14.356505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:14.364567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:14.365007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:14.365811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:14.366236 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:14.429649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:14.438031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8c615967-6f32-4ff8-ac18-f87ad7d396c7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088738 Dec 17 13:10:14.438571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1340/2676] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:15.454945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:15.455529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:15.462843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:15.463309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:15.464129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:15.464576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:15.531728 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:15.539561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e2136630-cefa-4e39-886c-95f879f185f7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088486 Dec 17 13:10:15.540114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1337/2677] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:16.559823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:16.560794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:16.571193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:16.571927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:16.573182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:16.573949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:16.633580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:16.641485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8ea876ac-9305-4f07-b51a-8934600fd9a6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087815 Dec 17 13:10:16.642038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1341/2678] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:17.660008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:17.660772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:17.668871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:17.669469 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:17.670420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:17.670956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:17.732655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:17.740758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2dcbe760-7fdf-4f29-a6dc-e829f081c086 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085777 Dec 17 13:10:17.741316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1338/2679] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:18.760971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:18.762041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:18.769771 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:18.770223 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:18.771012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:18.771442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:18.837463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:18.845690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f305445b-3f48-48f5-b6b1-39419bc9ca16 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090831 Dec 17 13:10:18.846249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1342/2680] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:19.862021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:19.862624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:19.869309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:19.869755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:19.870522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:19.870945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:19.938638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:19.946826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-214e93ed-15e0-4256-b7ab-6fb4e966bd27 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088550 Dec 17 13:10:19.947384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1339/2681] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:20.967966 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:20.968941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:20.979909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:20.980639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:20.982038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:20.982758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:21.040627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:21.048584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9a6bdd62-a838-47f4-ab57-c4d475a802d5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087098 Dec 17 13:10:21.049155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1343/2682] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:22.068905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:22.069994 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:22.080182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:22.080845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:22.082198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:22.082917 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:22.148852 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:22.157256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f3ae7ce0-6f63-4fcb-8c93-1890dea5fd36 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094427 Dec 17 13:10:22.157850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1340/2683] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:23.177868 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:23.178791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:23.189512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:23.190265 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:23.191558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:23.192289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:23.256346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:23.267406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-49a52242-f403-4649-ab27-956a44bf35f3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.095887 Dec 17 13:10:23.267974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1344/2684] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:23 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:24.284185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:24.284856 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:24.291877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:24.292331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:24.293118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:24.293603 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:24.354279 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:24.362160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-47edd137-84ef-453d-9f5f-4bb563286ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.081897 Dec 17 13:10:24.362741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1341/2685] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:25.382388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:25.383396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:25.393379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:25.393945 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:25.395117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:25.395673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:25.472708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:25.480623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f59e71ae-fbf7-4c0e-9179-8493b74cb1f8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.104275 Dec 17 13:10:25.481153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1345/2686] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:26.500792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:26.501473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:26.508081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:26.508527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:26.509299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:26.509767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:26.575181 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:26.583232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-613c460a-97f1-48a0-8094-8c686b42d3bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088008 Dec 17 13:10:26.583792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1342/2687] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:27.603631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:27.604594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:27.615233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:27.615983 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:27.617414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:27.618181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:27.678904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:27.687243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-463714b8-a4ed-4894-99bb-0c57e761db73 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089803 Dec 17 13:10:27.687819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1346/2688] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:28.707711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:28.708775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:28.720069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:28.720829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:28.722158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:28.722885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:28.794459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:28.802878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2384e68-b64a-41e5-9e5f-722163b8eaf0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.101366 Dec 17 13:10:28.803439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1343/2689] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:29.821217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:29.821930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:29.829561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:29.830079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:29.830990 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:29.831491 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:29.896033 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:29.903886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44e66817-7266-4213-ad9e-03dc12cd8a30 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087555 Dec 17 13:10:29.904421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1347/2690] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:30.929533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:30.930609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:30.942018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:30.943109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:30.944429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:30.945159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:31.008825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:31.021330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3d00ab2b-5eea-4a3d-a84a-eea19dc04fbe tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097758 Dec 17 13:10:31.022111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1344/2691] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:32.044171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:32.045240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:32.056038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:32.056789 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:32.058139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:32.058858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:32.119839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:32.128099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a8bea7b2-c3b2-4701-a011-d8e39b9e776a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090408 Dec 17 13:10:32.128667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1348/2692] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:33.147683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:33.148607 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:33.159301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:33.160044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:33.161363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:33.162006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:33.223625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:33.232068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-97a39e8a-fd84-46bb-90d5-c2f0507dce2e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090533 Dec 17 13:10:33.232633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1345/2693] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:10:34.251407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:34.252148 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:34.260739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:34.261354 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:34.262521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:34.263105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:34.325679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:34.333703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-479184db-ae9d-4eb3-bbd6-18d4ffbf0167 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088262 Dec 17 13:10:34.334270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1349/2694] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:34 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:35.357860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:35.358975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:35.368467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:35.368908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:35.369738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:35.370164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:35.439687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:35.448212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b8a8c673-4e9b-4a14-b6b8-57247720385a tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096498 Dec 17 13:10:35.448776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1346/2695] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:36.468294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:36.468936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:36.475952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:36.476403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:36.477187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:36.477658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:36.537306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:36.545752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-987e175c-8c4b-41c1-8ef1-2ca5684fd604 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083970 Dec 17 13:10:36.546322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1350/2696] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:37.571699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:37.572757 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:37.581312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:37.581802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:37.582583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:37.583018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:37.642746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:37.650742 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7c232be0-5644-4a5f-ab5f-1c087e0d0417 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.085299 Dec 17 13:10:37.651318 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1347/2697] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:38.671645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:38.672699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:38.683247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:38.684003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:38.685298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:38.686042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:38.748395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:38.756560 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7860c428-0669-4eab-81ac-7d63032982fd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091271 Dec 17 13:10:38.757132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1351/2698] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:39.777158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:39.777831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:39.786737 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:39.787190 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:39.787974 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:39.788411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:39.855516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:39.864160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d5a40eef-2c91-4e3a-831e-e0c311be3808 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092953 Dec 17 13:10:39.864736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1348/2699] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:40.881190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:40.882217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:40.889725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:40.890168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:40.890951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:40.891380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:40.952131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:40.960633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-acca8033-a406-4b2e-80f7-ae3e1bfe5021 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084335 Dec 17 13:10:40.961196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1352/2700] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:41.985180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:41.986180 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:41.993498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:41.993945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:41.994726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:41.995186 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:42.054755 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:42.062745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f0a245d7-3c7d-410f-8df6-5528e0a5aac8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084342 Dec 17 13:10:42.063307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1349/2701] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:43.083482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:43.084446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:43.095407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:43.096197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:43.096979 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:43.097446 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:43.156035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:43.164058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-91eb0ea9-168c-4807-9033-81a5b00e9b76 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087008 Dec 17 13:10:43.164626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1353/2702] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:44.183776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:44.184626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:44.195047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:44.195776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:44.197127 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:44.197902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:44.260192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:44.268637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4f198b6a-c3da-499a-a422-3d198e146185 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090641 Dec 17 13:10:44.269632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1350/2703] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:44 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:45.291818 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:45.293151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:45.302852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:45.303458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:45.304670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:45.305344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:45.365739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:45.373761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5d97a475-4fc2-4c51-91b8-48eea07ff183 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086499 Dec 17 13:10:45.374319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1354/2704] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:46.394025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:46.394948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:46.405474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:46.406211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:46.407477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:46.408185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:46.473721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:46.485628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d0c30f67-ad4f-44de-8a5f-c723060f60a1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097571 Dec 17 13:10:46.486432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1351/2705] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:47.506420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:47.507432 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:47.518277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:47.519010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:47.520320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:47.520982 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:47.587812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:47.596390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-42425e58-1491-4218-81b4-b2086890b453 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096267 Dec 17 13:10:47.596947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1355/2706] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:48.617150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:48.618196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:48.628950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:48.629758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:48.631044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:48.631763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:48.699194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:48.707294 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-12ea69f6-3f6a-4c7e-a434-45521dc29ff4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096428 Dec 17 13:10:48.707867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1352/2707] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:49.728420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:49.729402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:49.739796 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:49.740541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:49.741854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:49.742582 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:49.819664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:49.828594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-640da701-a5ec-4559-b186-1e040797b96f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.106504 Dec 17 13:10:49.829521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1356/2708] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:50.849045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:50.849694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:50.858560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:50.859155 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:50.860283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:50.860895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:50.919708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:50.930146 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-63798273-beca-4b52-8950-d2d2238306dc tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087280 Dec 17 13:10:50.930714 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1353/2709] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:50 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:51.948687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:51.949463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:51.957653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:51.958207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:51.959159 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:51.962808 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:52.028670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:52.036627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fcaaad85-9e2e-4325-9829-8d3141089eb6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092840 Dec 17 13:10:52.037197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1357/2710] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:51 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:53.056536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:53.057440 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:53.067340 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:53.068034 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:53.069233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:53.069951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:53.135438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:53.144192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-eacd0542-1bd1-4317-bb71-487cf562e121 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093331 Dec 17 13:10:53.144763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1354/2711] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:53 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:54.164994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:54.166118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:54.176890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:54.177706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:54.178987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:54.179706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:54.243764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:54.255717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-836ff055-9bc4-476e-b515-b7d0ef813eee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096992 Dec 17 13:10:54.256298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1358/2712] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:54 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:55.276582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:55.277844 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:55.286920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:55.287373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:55.288199 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:55.288637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:55.354013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:55.361802 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d317e13f-1c88-4541-8543-dab68d611822 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091269 Dec 17 13:10:55.362406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1355/2713] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:55 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:56.381636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:56.382312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:56.389721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:56.390220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:56.391090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:56.391571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:56.457543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:56.465840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-97beb98a-00b3-45ca-b518-3b61776ca7d0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089674 Dec 17 13:10:56.466764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1359/2714] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:56 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:57.486790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:57.487741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:57.498419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:57.499160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:57.500423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:57.501173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:57.563521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:57.571252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a613ff6a-a364-4737-922f-701a5454ba1c tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090410 Dec 17 13:10:57.571825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1356/2715] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:57 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:58.592431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:58.593475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:58.604042 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:58.604908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:58.606251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:58.606984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:58.676525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:58.685103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e1f9cbb3-58c3-4de8-8c21-f183a0cf3ce9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099250 Dec 17 13:10:58.685741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1360/2716] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:58 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:10:59.705334 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:10:59.706346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:10:59.717923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:59.718664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:59.720040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:10:59.720760 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:10:59.782762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:10:59.794210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a73c0211-00d4-471a-9ebf-ae0a8bf1b5e7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094675 Dec 17 13:10:59.794950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1357/2717] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:10:59 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:00.816302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:00.817329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:00.828002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:00.829255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:00.830062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:00.830782 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:00.892613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:00.902637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aed3dbdb-a36a-4ac4-8bbd-ac98b3e1b29f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092332 Dec 17 13:11:00.903212 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1361/2718] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:00 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:01.923939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:01.924890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:01.935370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:01.936113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:01.937448 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:01.938161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:02.003674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:02.011751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e604de26-b7fa-4895-9d96-48457f41aa99 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093899 Dec 17 13:11:02.012299 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1358/2719] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:01 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:03.033073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:03.034098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:03.045701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:03.046443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:03.047746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:03.048456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:03.107587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:03.115919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-074dc777-c97f-45e6-af4a-fe0b4064bf46 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089768 Dec 17 13:11:03.116512 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1362/2720] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:03 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:04.136269 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:04.137148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:04.147922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:04.148672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:04.150036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:04.150767 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:04.219198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:04.227797 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b443365a-0210-4f05-ac44-b8e0f80392b0 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097782 Dec 17 13:11:04.228437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1359/2721] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:04 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:05.249022 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:05.250037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:05.260819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:05.261637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:05.262930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:05.263682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:05.330906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:05.340323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-66098911-b880-43b5-bded-93035a143854 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.097670 Dec 17 13:11:05.340925 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1363/2722] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:05 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:06.361356 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:06.362398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:06.372998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:06.373798 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:06.375074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:06.375943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:06.435910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:06.444265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-943e8807-8a76-444b-ba3d-de7164d1c8c6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089048 Dec 17 13:11:06.444830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1360/2723] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:06 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:07.465178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:07.466748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:07.477755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:07.478501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:07.479774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:07.480492 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:07.541708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:07.550120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-de05ab01-6675-4c3c-a364-b93548af880b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091382 Dec 17 13:11:07.550698 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1364/2724] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:07 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:08.569411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:08.570080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:08.576598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:08.577048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:08.577866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:08.578300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:08.644102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:08.652165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b27832e3-40db-4e37-83ba-d44a47bce295 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088414 Dec 17 13:11:08.652735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1361/2725] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:08 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:09.672083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:09.673217 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:09.681410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:09.681863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:09.682645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:09.683082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:09.750538 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:09.759242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-bf946c59-f09a-496c-b4be-4b35648e5ab2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093762 Dec 17 13:11:09.759834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1365/2726] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:09 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:10.779977 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:10.781006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:10.789511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:10.789962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:10.790734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:10.791164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:10.851605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:10.859817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cfc47578-049e-4b1c-8a75-25346da070ee tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086169 Dec 17 13:11:10.860382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1362/2727] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:10 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:11.877334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:11.878015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:11.885214 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:11.885703 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:11.886486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:11.886917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:11.954105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:11.962396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-07d206fa-d739-4e75-9060-146f79b2f437 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088961 Dec 17 13:11:11.963193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1366/2728] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:11 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:12.979113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:12.979741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:12.986458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:12.986903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:12.987666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:12.988100 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:13.053310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:13.061549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a86cedea-55b1-4b7c-88a2-746021aec145 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.086148 Dec 17 13:11:13.062109 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1363/2729] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:12 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:14.082254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:14.083146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:14.090341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:14.090783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:14.091890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:14.092315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:14.159671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:14.168151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7bfcf424-bb4c-466d-99e9-31b6ad19f8f2 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092384 Dec 17 13:11:14.168721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1367/2730] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:14 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:15.187809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:15.188398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:15.194996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:15.195437 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:15.196210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:15.196643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:15.268537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:15.276861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ae297e4-24b7-4522-9adb-8b1528579970 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092902 Dec 17 13:11:15.277467 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1364/2731] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:15 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:16.297461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:16.298410 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:16.307173 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:16.307622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:16.308395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:16.308832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:16.375927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:16.384051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-594c4243-01e5-4225-8488-b36a6c3f41bb tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092797 Dec 17 13:11:16.384615 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1368/2732] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:16 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:17.403300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:17.404069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:17.412427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:17.413071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:17.413891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:17.414309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:17.473258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:17.481597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd833a66-0bd2-4433-b9cc-120fb892c0d3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083138 Dec 17 13:11:17.482144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1365/2733] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:17 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:18.506482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:18.507458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:18.518231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:18.518973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:18.520254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:18.520985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:18.582323 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:18.590733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-be6135ad-66ac-4207-a28f-0e51f1e7fa4b tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090509 Dec 17 13:11:18.591315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1369/2734] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:18 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:19.611335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:19.612292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:19.622886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:19.623622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:19.624891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:19.625693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:19.686641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:19.695143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a3cf0e8-ff85-4042-88f8-509cc9eb83f6 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089999 Dec 17 13:11:19.695749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1366/2735] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:19 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:20.714537 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:20.715255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:20.722978 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:20.723505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:20.724414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:20.724921 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:20.785498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:20.793543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e371ec5f-f334-44c5-be5c-9351fe8a35e5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.083941 Dec 17 13:11:20.794104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1370/2736] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:20 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:21.814075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:21.815040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:21.823128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:21.823576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:21.824378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:21.824817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:21.883807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:21.891795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-fd6d8729-d6d3-4e46-9a06-cbb907f01518 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084100 Dec 17 13:11:21.892348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1367/2737] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:21 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:22.912105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:22.913157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:22.921388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:22.921994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:22.922963 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:22.923505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:22.985515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:22.993934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0830c695-5e9c-488b-ad79-5af039a78378 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087997 Dec 17 13:11:22.994508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1371/2738] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:22 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:24.014488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:24.015447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:24.024794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:24.025238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:24.026179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:24.026609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:24.089092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:24.097490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77cd2a08-f62e-4588-9ba6-6ad03a1365da tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.089363 Dec 17 13:11:24.098047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1368/2739] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:24 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:25.117862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:25.118734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:25.129339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:25.130100 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:25.131361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:25.132029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:25.191406 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:25.199608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2d7d30f1-218a-4dc9-b323-36068ea43735 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088001 Dec 17 13:11:25.200198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1372/2740] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:25 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:26.220261 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:26.221063 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:26.228343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:26.228816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:26.229739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:26.230169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:26.291343 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:26.300682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c650bb71-fb17-4b98-8377-4a07f84e64f5 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084389 Dec 17 13:11:26.301247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1369/2741] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:26 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:27.321478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:27.322420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:27.333031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:27.333829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:27.335102 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:27.335823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:27.401119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:27.409307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a1761c8e-379e-47ca-9977-7ac9836f8a8e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.094209 Dec 17 13:11:27.409899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1373/2742] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:27 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:28.430276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:28.431291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:28.441722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:28.442456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:28.443716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:28.444428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:28.515188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:28.523625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-654f40cc-8cc2-4f9a-973a-f311e6dfce8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.099618 Dec 17 13:11:28.524182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1370/2743] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:28 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:29.544132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:29.545121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:29.555843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:29.556597 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:29.557961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:29.558689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:29.626080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:29.634361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-680ae225-f1a2-45cd-b515-16991e5d11b4 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096445 Dec 17 13:11:29.634933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1374/2744] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:29 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:30.655430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:30.656297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:30.666925 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:30.667674 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:30.668955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:30.669736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:30.733498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:30.742473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-536f6e00-2930-4415-8754-3aeeecd41e67 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.093520 Dec 17 13:11:30.743048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1371/2745] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:30 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:11:31.763048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:31.764125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:31.774825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:31.775570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:31.776840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:31.777608 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:31.839867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:31.848379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c8aaab44-297d-46d7-b790-c09a216b2f35 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091590 Dec 17 13:11:31.848985 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1375/2746] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:31 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:32.865709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:32.866281 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:32.873042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:32.873527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:32.874306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:32.874741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:32.941615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:32.950014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-99313772-0d49-42d2-8ea5-bf5193f293b8 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088132 Dec 17 13:11:32.950592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1372/2747] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:32 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:33.970935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:33.971916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:33.979931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:33.980379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:33.981191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:33.981704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:34.041398 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:34.049412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-86e2b6f7-a5d6-42c0-8e3f-b83ad9234600 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084976 Dec 17 13:11:34.049973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1376/2748] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:33 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:35.069374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:35.070406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:35.081106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:35.081810 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:35.083070 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:35.083785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:35.144193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:35.153765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-61cef600-9881-4e52-932e-2d45d5cde719 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090656 Dec 17 13:11:35.154335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1373/2749] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:35 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:36.174907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:36.175792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:36.186318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:36.187032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:36.188338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:36.189061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:36.251337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:36.259359 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1ebb5863-c265-455a-821d-3e53d3f36ee3 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.090800 Dec 17 13:11:36.259930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1377/2750] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:36 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:37.279813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:37.280845 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:37.291847 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:37.292591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:37.293956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:37.294697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:37.357699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:37.365567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-83a088ac-0485-4a5e-afa0-345b8c9f9555 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091919 Dec 17 13:11:37.366249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1374/2751] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:37 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:38.386041 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:38.387015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:38.397707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:38.398453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:38.399735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:38.400454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:38.463160 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:38.471369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aa6a074c-3d74-401d-983b-035da3b941a9 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091628 Dec 17 13:11:38.471932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1378/2752] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:38 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:39.489417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:39.489976 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:39.496732 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:39.497179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:39.497984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:39.498411 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:39.556347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:39.564867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b09dd134-ca78-433d-9174-b0d07f2dda8d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.079340 Dec 17 13:11:39.565477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1375/2753] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:39 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:40.585071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:40.586319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:40.597037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:40.597842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:40.599147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:40.599870 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:40.657809 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:40.666112 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-706e5255-70b8-4dc0-9214-997cf5da7e56 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.087095 Dec 17 13:11:40.666690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1379/2754] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:40 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:41.686886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:41.687866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:41.696933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:41.697415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:41.698188 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:41.698647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:41.764649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:41.772973 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2cdd2449-535a-41e6-a6e3-6f8832350d08 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.092317 Dec 17 13:11:41.773575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1376/2755] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:41 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:42.790938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:42.791677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:42.799340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:42.799790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:42.800564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:42.800994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:42.881079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:42.889270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-39432832-3b03-44a6-83a8-f423c68aad9f tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.102918 Dec 17 13:11:42.890373 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1380/2756] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:42 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:43.906563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:43.907170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:43.914005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:43.914449 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:43.915220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:43.915653 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:43.979077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:43.987247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5e32251b-4138-4c74-800a-1271d09f437d tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.084449 Dec 17 13:11:43.987813 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1377/2757] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:43 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:45.007999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:45.008935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:45.019488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:45.020239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:45.021570 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:45.022433 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:45.081780 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:45.089829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b66dbc10-c2fc-45d7-91b0-214ce3629910 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.088042 Dec 17 13:11:45.090389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1381/2758] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:45 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:46.110902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:46.111795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:46.122275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:46.123021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:46.124368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:46.125094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:46.187587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:46.195569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dba05665-cf00-4929-9516-267802cd5fb1 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.091023 Dec 17 13:11:46.196133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1378/2759] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:46 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:47.214706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:47.215441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:47.223787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:47.224341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:47.225334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:47.225873 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:47.297790 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:47.306256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-23f094ae-e249-4a2b-a3d7-93826dd858dd tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.096555 Dec 17 13:11:47.306828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1382/2760] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:47 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:48.331359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:48.332285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:48.343315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:48.344093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:48.345459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:48.346174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:48.415152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542a07a0f121447aa2e0ace9d59ab9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a479e98f4445759fa76f0a90380028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:48.427239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b5cc6f1-7d7f-4d69-9319-5089c9c3803e tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 200 len: 1352 microversion: 2.1 time: 0.101808 Dec 17 13:11:48.428035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1379/2761] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:48 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:48.714054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa2869e6-26f4-4081-862c-cc6dc2173417"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:11:48.715110 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:48.721834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:48.722283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:48.723075 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:48.723527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:48.983999 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d643a24f-1ef7-414b-86a4-3fd1dbbe7cf4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273875 Dec 17 13:11:48.989065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1383/2762] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 13:11:48 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:11:49.452402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:49.453643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] [instance: 21d1af76-68e9-4515-8374-ecae895e7c09] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:49.462654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:49.463110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:49.463943 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:49.464363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:49.478147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] HTTP exception thrown: Instance 21d1af76-68e9-4515-8374-ecae895e7c09 could not be found. Dec 17 13:11:49.478734 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] Returning 404 to user: Instance 21d1af76-68e9-4515-8374-ecae895e7c09 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:11:49.479553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2bc082e-fe39-4134-86c6-827b733b9be7 tempest-ServerRescueNegativeTestJSON-2063284444 tempest-ServerRescueNegativeTestJSON-2063284444-project] 10.222.0.45 "GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09" status: 404 len: 111 microversion: 2.1 time: 0.033380 Dec 17 13:11:49.480085 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1380/2763] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:49 2021] GET /compute/v2.1/servers/21d1af76-68e9-4515-8374-ecae895e7c09 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:11:50.634362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:11:50.634918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:11:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:11:57.560695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d630bf9a-6cc8-40f7-b523-e2393966dfed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:11:57.568095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d630bf9a-6cc8-40f7-b523-e2393966dfed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:57.568528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d630bf9a-6cc8-40f7-b523-e2393966dfed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:57.635174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d630bf9a-6cc8-40f7-b523-e2393966dfed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Going to try to stop instance {{(pid=127717) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 17 13:11:57.683678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d630bf9a-6cc8-40f7-b523-e2393966dfed tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 202 len: 0 microversion: 2.1 time: 0.126854 Dec 17 13:11:57.684281 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1384/2764] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:11:57 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:11:57.692256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:57.693029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:57.699442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:57.699966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:57.700833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:57.701342 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:57.843346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:57.851761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e886500e-5774-40b5-9c4b-95a28177c20d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.163253 Dec 17 13:11:57.852524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1381/2765] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:57 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:11:58.871658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:11:58.872456 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:11:58.881656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:58.882760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:58.884145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:11:58.884725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:11:59.032661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:11:59.040539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8bb8bba8-9698-42a8-b35d-b5dd71cd0e39 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.173214 Dec 17 13:11:59.041099 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1385/2766] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:11:58 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:00.058512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:00.059247 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:00.065581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:00.066032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:00.066825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:00.067264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:00.220506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:00.228873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c2e80c88-655e-43c4-8c59-4d7060114c1c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.174175 Dec 17 13:12:00.229552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1382/2767] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:00 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:01.246190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:01.246711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:01.253362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:01.253807 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:01.254588 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:01.255018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:01.385939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:01.394294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8b476785-17e3-4ab3-82aa-afdcff022265 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.151861 Dec 17 13:12:01.394897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1386/2768] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:01 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:02.410259 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:02.410873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:02.417315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:02.417792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:02.418570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:02.418998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:02.558322 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:02.566347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2c0f7319-8de3-44f1-90e1-7cc0364c69bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.159818 Dec 17 13:12:02.566915 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1383/2769] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:02 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:03.583228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:03.583836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:03.590434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:03.590884 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:03.591669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:03.592107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:03.739760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:03.749224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-18af4b42-3fa0-4961-bbc0-cb65a7ff4402 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.169675 Dec 17 13:12:03.750034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1387/2770] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:03 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:04.770663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:04.771663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:04.781652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:04.782402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:04.783677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:04.784392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:04.919344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:04.927545 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-10e7d23f-19d6-420f-bea6-36cb8cffefca tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.163031 Dec 17 13:12:04.928118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1384/2771] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:04 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:05.945092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:05.945777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:05.952137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:05.952578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:05.953394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:05.953822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:06.086282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:06.094871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-197c7c04-38b2-4099-bce7-6670d35c2e21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.153604 Dec 17 13:12:06.095447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1388/2772] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:05 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:07.115777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:07.116772 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:07.127285 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:07.128032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:07.129325 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:07.130036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:07.261642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:07.269950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2f1c7fe7-5acb-41c8-9f19-8364240e0721 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.160380 Dec 17 13:12:07.270527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1385/2773] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:07 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:08.290620 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:08.291673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:08.298457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:08.298903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:08.299678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:08.300139 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:08.437645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:08.445848 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-30b4be0d-223d-46b8-815c-705c5e8b0b6d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.161536 Dec 17 13:12:08.446428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1389/2774] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:08 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:09.465500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:09.466192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:09.473152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:09.473634 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:09.474412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:09.474841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:09.607822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:09.615679 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f0ad5dac-dd22-460b-a20f-05f39a7a4d32 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.155568 Dec 17 13:12:09.616253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1386/2775] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:09 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:10.636927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:10.637988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:10.648718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:10.649524 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:10.650804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:10.651557 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:10.790941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:10.800154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-08e5d12a-9c32-421e-a503-4d2991fef7fb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.169541 Dec 17 13:12:10.800731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1390/2776] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:10 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:11.817542 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:11.818270 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:11.826741 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:11.827174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:11.828147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:11.828584 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:11.962014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:11.971297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9e93159d-f4b0-45b8-9d1b-3e75becda6d5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.157327 Dec 17 13:12:11.972045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1387/2777] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:11 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:12.989443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:12.990286 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:12.997014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:12.997541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:12.998427 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:12.999078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:13.129087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:13.137412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-92f4aa94-bf4b-44ed-9ddc-d15632093e83 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.151978 Dec 17 13:12:13.146971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1391/2778] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:12 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:14.154306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:14.154849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:14.160929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:14.161362 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:14.162131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:14.162795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:14.295096 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:14.303094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f91adf36-434e-4f11-bd04-56f555a0551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.152731 Dec 17 13:12:14.303650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1388/2779] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:14 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:15.323208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:15.324253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:15.334850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:15.335593 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:15.336867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:15.337662 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:15.473617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:15.486248 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9ac42b60-1de2-42a4-8280-2a3f09b7aaab tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1724 microversion: 2.1 time: 0.168994 Dec 17 13:12:15.487094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1392/2780] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:15 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:16.503774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:16.504582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:16.511158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:16.511605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:16.512374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:16.512795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:16.657883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:16.666375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bb8bae15-0087-46f3-bde7-bbec3d9c579d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1701 microversion: 2.1 time: 0.166392 Dec 17 13:12:16.667116 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1389/2781] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:16 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:16.683543 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e080d4b-47fd-4403-b599-d980065a895c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:12:16.690293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e080d4b-47fd-4403-b599-d980065a895c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:16.690735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e080d4b-47fd-4403-b599-d980065a895c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:16.714179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2e080d4b-47fd-4403-b599-d980065a895c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Going to try to start instance {{(pid=127717) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 17 13:12:16.758633 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e080d4b-47fd-4403-b599-d980065a895c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 202 len: 0 microversion: 2.1 time: 0.078472 Dec 17 13:12:16.759242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1393/2782] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:12:16 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:12:16.767543 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:16.768428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:16.775298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:16.775838 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:16.776695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:16.777091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:16.915888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:16.923964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-79996ec3-a53d-4d07-9bd2-23f232531f24 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1710 microversion: 2.1 time: 0.160314 Dec 17 13:12:16.924567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1390/2783] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:16 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:17.942062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:17.942832 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:17.950381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:17.950829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:17.951596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:17.952032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:18.086747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:18.097231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6d07c76b-68bd-4acb-a5be-eebc6b955f61 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1710 microversion: 2.1 time: 0.159248 Dec 17 13:12:18.097598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1394/2784] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:17 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:19.116595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:12:19.117204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:12:19.124210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:19.124650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:19.125459 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:12:19.125913 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:12:19.267611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:12:19.275996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-97f53a2a-21b6-4d11-88a4-e731acd8e335 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1714 microversion: 2.1 time: 0.163259 Dec 17 13:12:19.276583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1391/2785] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:12:19 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:12:48.648498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Action: 'create', calling method: .version_select at 0x7fba11e40550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1204495767"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:12:48.664402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for project 84f552590cfc426787d4bd1d01c981c2. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:12:48.668355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for user ecd0455cb0ac44e592f820a8499ec077 and project 84f552590cfc426787d4bd1d01c981c2. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:12:48.808098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for project 84f552590cfc426787d4bd1d01c981c2. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:12:48.813377 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for user ecd0455cb0ac44e592f820a8499ec077 and project 84f552590cfc426787d4bd1d01c981c2. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:12:48.827490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-adc66fc7-8d9c-48d9-92b5-1fdc3f68167d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.505545 Dec 17 13:12:48.828209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1395/2786] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Dec 17 13:12:48 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:24.276856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:13:24.278699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:13:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:13:25.967505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:13:25.968030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:13:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:13:30.504518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1040649293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1204495767", "security_groups": [{"name": "tempest-secgroup-smoke-95302233"}], "networks": [{"uuid": "7de8c8c7-0572-49fe-8758-4fdb2c1a3d31"}], "block_device_mapping_v2": [{"uuid": "5f5232f8-81c3-426b-a4a1-8f9d72815ae2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:13:30.876961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] validate_networks() for [('7de8c8c7-0572-49fe-8758-4fdb2c1a3d31', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:13:31.345709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:13:31.346138 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:13:31.346613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:13:31.347006 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:13:31.347415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:13:31.357511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:31.358009 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:31.358829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:31.359265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:31.376703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for project 84f552590cfc426787d4bd1d01c981c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:13:31.381307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Getting quotas for user ecd0455cb0ac44e592f820a8499ec077 and project 84f552590cfc426787d4bd1d01c981c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:13:31.443162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:13:31.445372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f5232f8-81c3-426b-a4a1-8f9d72815ae2',volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:13:31.576854 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-30fe1155-b505-47b4-8e60-a91a7d8fb23f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.076956 Dec 17 13:13:31.577924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1392/2787] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:13:30 2021] POST /compute/v2.1/servers => generated 404 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 17 13:13:31.588208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3c053c21-1fba-4415-bec6-5ffd1f54ec2c tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:31.589005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3c053c21-1fba-4415-bec6-5ffd1f54ec2c tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:31.701294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3c053c21-1fba-4415-bec6-5ffd1f54ec2c tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:31.708769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3c053c21-1fba-4415-bec6-5ffd1f54ec2c tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1089 microversion: 2.1 time: 0.124998 Dec 17 13:13:31.709474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1396/2788] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:31 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:13:32.726504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:32.727576 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:32.734174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:32.734646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:32.735718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:32.735881 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:32.803967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:32.809726 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c576ce4c-18bb-4ec9-be73-62d5de6abf42 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1195 microversion: 2.1 time: 0.087238 Dec 17 13:13:32.810406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1393/2789] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:32 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:33.827292 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:33.827898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:33.834417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:33.834860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:33.835686 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:33.836931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:34.074828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:34.082601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e38e0e0-231c-4641-ba67-76d1d8223400 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.258977 Dec 17 13:13:34.083195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1397/2790] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:33 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:34.327904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:13:34.329703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:13:34.329703 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:13:34.338094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:34.338642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:34.350507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] Creating event network-changed:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:13:34.354368 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: ERROR oslo.messaging._drivers.impl_rabbit [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] [02adb3e7-2bd1-44e3-989f-0397e1478838] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 17 13:13:35.100065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:35.100681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:35.107574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:35.108073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:35.108919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:35.109390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:35.257475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:35.266519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-20b332d8-4f12-4db9-87f1-ae45447d54b9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.170023 Dec 17 13:13:35.267115 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1398/2791] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:35 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:35.374765 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] [02adb3e7-2bd1-44e3-989f-0397e1478838] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43366. Dec 17 13:13:35.380626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-522c293a-4605-4303-9f50-792e0a3ed0f6 req-e809dc8b-011f-4ce6-a4ce-ebbc334a6a9a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.144443 Dec 17 13:13:35.381699 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1394/2792] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:13:36.286200 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:36.286843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:36.296617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:36.297435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:36.298450 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:36.298880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:36.463907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:36.472972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-83c4969a-272a-4714-a9e2-beca23008883 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.192082 Dec 17 13:13:36.473690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1399/2793] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:36 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:37.491113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:37.492242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:37.502429 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:37.502875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:37.503659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:37.504082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:37.654771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:37.662463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6a26121b-b85e-4cd7-a68b-b6b3b8fb851a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.176100 Dec 17 13:13:37.663028 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1395/2794] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:37 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:38.679330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:38.679957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:38.687346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:38.687810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:38.688601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:38.689027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:38.833382 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:38.841098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ab2ac31b-1fed-4747-8f2d-bc02b41e2007 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.165488 Dec 17 13:13:38.841692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1400/2795] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:38 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:39.858335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:39.858980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:39.867577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:39.868167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:39.869383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:39.869963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:40.021931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:40.030360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7dcb5639-4f9c-460b-8606-27b74e6b61a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.175686 Dec 17 13:13:40.030920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1396/2796] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:39 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:41.047472 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:41.048066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:41.055677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:41.056355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:41.057534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:41.058183 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:41.210856 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:41.219045 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ce1f2eb0-2ec9-428d-9784-2b14a775008e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.175459 Dec 17 13:13:41.219961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1401/2797] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:41 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:42.235942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:42.236553 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:42.244077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:42.244588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:42.245599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:42.246030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:42.392128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:42.400192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1195d03-2d1d-4068-84a2-f79ade93c589 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.168060 Dec 17 13:13:42.400805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1397/2798] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:42 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:43.417480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:43.418507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:43.428474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:43.429400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:43.430684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:43.431429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:43.626179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:43.635393 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a5fd690a-bb53-4085-9619-8af0da0a6b30 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.221869 Dec 17 13:13:43.635954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1402/2799] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:43 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:44.655278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:44.656122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:44.665596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:44.666191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:44.667476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:44.668192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:44.803167 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:44.810609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6c700b2-cd46-4003-9082-9d1f2767ba92 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.161055 Dec 17 13:13:44.811243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1398/2800] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:44 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:45.828060 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:45.828861 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:45.835079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:45.835528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:45.836312 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:45.836814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:46.030320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:46.038600 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-652f0add-0904-464d-ad60-691fdf43f65a tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.214483 Dec 17 13:13:46.039165 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1403/2801] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:45 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:47.055445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:47.056361 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:47.064624 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:47.065504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:47.066383 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:47.066824 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:47.231256 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:47.240752 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e957b265-1118-4504-93f2-2695e18683a2 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.189108 Dec 17 13:13:47.250460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1399/2802] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:47 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:47.292971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-3775b8a1-47b3-4723-8314-ea6bfd9a81ec req-bb999165-dac0-4daf-bd73-efad13b2fc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "name": "network-vif-plugged", "status": "completed", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:13:47.296242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:13:47.296242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:13:47.304816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-3775b8a1-47b3-4723-8314-ea6bfd9a81ec req-bb999165-dac0-4daf-bd73-efad13b2fc03 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:47.305259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-3775b8a1-47b3-4723-8314-ea6bfd9a81ec req-bb999165-dac0-4daf-bd73-efad13b2fc03 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:47.317474 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-3775b8a1-47b3-4723-8314-ea6bfd9a81ec req-bb999165-dac0-4daf-bd73-efad13b2fc03 service nova] Creating event network-vif-plugged:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:13:47.323400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-3775b8a1-47b3-4723-8314-ea6bfd9a81ec req-bb999165-dac0-4daf-bd73-efad13b2fc03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097250 Dec 17 13:13:47.324017 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1404/2803] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:13:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:13:48.257705 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:48.258397 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:48.264848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:48.265321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:48.266118 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:48.266557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:48.423549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:48.431102 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-38e69ab9-efc2-48cb-a1e7-1c373b54b698 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.177111 Dec 17 13:13:48.431672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1400/2804] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:48 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:49.448675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:49.449241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:49.456044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:49.456486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:49.457268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:49.457725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:49.599066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:49.606525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b128a36b-bde1-46cc-b01f-e50856291f08 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.162119 Dec 17 13:13:49.607107 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1405/2805] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:49 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:50.623906 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:50.624519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:50.631305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:50.631749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:50.632528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:50.632960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:50.775189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:50.786740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-235fa090-4daa-4769-b30d-d8cd1de4f195 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.166789 Dec 17 13:13:50.787582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1401/2806] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:50 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:51.807369 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:51.807958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:51.815857 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:51.816622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:51.817947 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:51.818670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:51.973528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:51.982465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b97c8c84-1819-47c1-98f5-a5c4b4aa20e9 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.178841 Dec 17 13:13:51.983049 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1406/2807] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:51 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:52.999533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:53.000148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:53.006789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:53.007236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:53.008014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:53.008445 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:53.150951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:53.158993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-af02ddf8-283c-4f9d-8b36-67ee82e75c9b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1259 microversion: 2.1 time: 0.163228 Dec 17 13:13:53.159586 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1402/2808] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:52 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:54.180819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:54.181741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:54.190219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:54.190674 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:54.191453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:54.191890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:54.334197 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:54.343458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-97b97aa0-1eae-4010-8ec7-040950284e65 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1443 microversion: 2.1 time: 0.168916 Dec 17 13:13:54.344439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1407/2809] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:54 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:54.361739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:13:54.362349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:13:54.369751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:54.370438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:54.371224 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:54.371645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:54.521036 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:13:54.529660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-acabbb88-dcf9-4059-9a64-9432511ba7e6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1443 microversion: 2.1 time: 0.172223 Dec 17 13:13:54.530253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1403/2810] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:13:54 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:13:56.763852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-e36871db-c00d-48ca-bc61-562fe14f0b8b req-8bf04a2a-360e-407b-966e-f9959241e395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:13:56.765482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:13:56.765482 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:13:56.777074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e36871db-c00d-48ca-bc61-562fe14f0b8b req-8bf04a2a-360e-407b-966e-f9959241e395 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:13:56.777837 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e36871db-c00d-48ca-bc61-562fe14f0b8b req-8bf04a2a-360e-407b-966e-f9959241e395 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:13:56.789740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-e36871db-c00d-48ca-bc61-562fe14f0b8b req-8bf04a2a-360e-407b-966e-f9959241e395 service nova] Creating event network-changed:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:13:56.795417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-e36871db-c00d-48ca-bc61-562fe14f0b8b req-8bf04a2a-360e-407b-966e-f9959241e395 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101602 Dec 17 13:13:56.796337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1408/2811] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:13:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:14:04.099140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:04.099620 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:04.106223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:04.106667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:04.107441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:04.108344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:04.193182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lazy-loading 'services' on Instance uuid 8b87a26d-6193-43d4-918a-92bb8c942c88 {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:14:04.271580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9c2d4e0a-0029-4793-8392-8094dc7d8a88 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments/fa2869e6-26f4-4081-862c-cc6dc2173417" status: 202 len: 0 microversion: 2.1 time: 0.423824 Dec 17 13:14:04.272160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1404/2812] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 13:14:03 2021] DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments/fa2869e6-26f4-4081-862c-cc6dc2173417 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:14:10.665675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-14830d9a-cd00-49e0-92c5-417fe8b72b44 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:14:10.672438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14830d9a-cd00-49e0-92c5-417fe8b72b44 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:10.673095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-14830d9a-cd00-49e0-92c5-417fe8b72b44 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:10.696332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-14830d9a-cd00-49e0-92c5-417fe8b72b44 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Going to try to stop instance {{(pid=127717) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 17 13:14:10.748564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-14830d9a-cd00-49e0-92c5-417fe8b72b44 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 202 len: 0 microversion: 2.1 time: 0.086763 Dec 17 13:14:10.749704 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1409/2813] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:14:10 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:14:10.759337 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:10.760019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:10.767408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:10.767794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:10.768871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:10.769326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:10.915321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:10.923196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-70eac2d8-99b1-44a5-b842-9c2343b2e0a5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.167961 Dec 17 13:14:10.923763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1405/2814] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:10 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:11.943258 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:11.944329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:11.953971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:11.954415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:11.955181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:11.955611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:12.103415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:12.111751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e8958c68-294b-4e6f-925a-b47b7871ccc1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.175265 Dec 17 13:14:12.112360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1410/2815] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:11 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:13.131112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:13.131710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:13.138616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:13.139050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:13.139825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:13.140502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:13.277038 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:13.289526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8348a4f8-0440-4861-a5aa-1101143814f4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.161918 Dec 17 13:14:13.290493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1406/2816] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:13 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:14.311905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:14.312546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:14.319738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:14.320184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:14.321007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:14.321479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:14.464384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:14.472628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1b37cf1e-c3d4-4aa5-b76d-10bea7e0bcdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.166049 Dec 17 13:14:14.473230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1411/2817] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:14 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:15.492084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:15.492651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:15.500137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:15.500581 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:15.501510 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:15.502176 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:15.642660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:15.650829 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d77b4bd-98cf-40d6-9614-c7849fb96520 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.162493 Dec 17 13:14:15.651385 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1407/2818] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:15 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:16.668367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:16.669147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:16.676005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:16.676636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:16.677436 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:16.677858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:16.819617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:16.829337 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-337f9328-bfec-4c1c-8943-bcde399e0c4a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.164820 Dec 17 13:14:16.829958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1412/2819] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:16 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:17.846846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:17.847435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:17.855590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:17.856026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:17.856827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:17.857249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:17.998039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:18.006148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-76f55a03-e946-42cd-8fdc-08ccd25e0f0f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.163411 Dec 17 13:14:18.006729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1408/2820] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:17 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:19.025994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:19.027004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:19.034505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:19.034946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:19.035705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:19.036131 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:19.196415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:19.204485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e0ad8e09-e301-4bd7-883a-1efc32ab469d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.184566 Dec 17 13:14:19.205031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1413/2821] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:19 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:20.221995 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:20.222525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:20.228944 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:20.229392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:20.230174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:20.230626 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:20.364536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:20.372484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f84b5ce3-94a6-4272-8424-1d0f5badef92 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.154812 Dec 17 13:14:20.373041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1409/2822] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:20 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:21.389795 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:21.390386 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:21.396874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:21.397321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:21.398062 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:21.398483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:21.530485 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:21.537843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d592bc1-639a-4d63-ba1a-39f5fe8a3436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.151749 Dec 17 13:14:21.538417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1414/2823] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:21 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:22.556650 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:22.557215 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:22.565483 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:22.565931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:22.566706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:22.567136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:22.709738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:22.717716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-736690e3-341c-451e-92c5-8960b24fa436 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.166563 Dec 17 13:14:22.718287 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1410/2824] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:22 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:23.735465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:23.736065 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:23.742858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:23.743306 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:23.744088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:23.744535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:23.907887 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:23.916160 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1442d62d-d7f4-44b0-a09b-2fcff16943f6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.184504 Dec 17 13:14:23.916738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1415/2825] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:23 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:24.933998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:24.934623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:24.941682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:24.942124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:24.942921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:24.943344 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:25.087480 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:25.099778 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-72ccd3ad-43de-47fe-a262-e0d331a752de tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1678 microversion: 2.1 time: 0.169329 Dec 17 13:14:25.100568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1411/2826] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:24 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:26.116954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:26.117636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:26.125211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:26.125892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:26.131259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:26.131259 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:26.278486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:26.286501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-219bfdfb-3e9b-459e-b206-0270f3854c09 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1655 microversion: 2.1 time: 0.173239 Dec 17 13:14:26.287078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1416/2827] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:26 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:26.307041 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-016f5a1a-e432-468d-a2e4-925f07abe08a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:14:26.316040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-016f5a1a-e432-468d-a2e4-925f07abe08a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:26.316524 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-016f5a1a-e432-468d-a2e4-925f07abe08a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:26.379373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-016f5a1a-e432-468d-a2e4-925f07abe08a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Going to try to start instance {{(pid=127716) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 17 13:14:26.429345 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-016f5a1a-e432-468d-a2e4-925f07abe08a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action" status: 202 len: 0 microversion: 2.1 time: 0.127861 Dec 17 13:14:26.429996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1412/2828] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:14:26 2021] POST /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:14:26.438692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:26.439486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:26.447031 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:26.447535 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:26.448431 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:26.448892 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:26.662628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:26.670874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c7e0d9bb-6c80-4176-ab1e-4ed377b757aa tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1664 microversion: 2.1 time: 0.236314 Dec 17 13:14:26.671683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1417/2829] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:26 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1664 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:14:27.692923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:14:27.694125 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:14:27.704150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:27.704593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:27.705436 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:14:27.705875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:14:27.850585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:14:27.862202 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-60178e22-bb79-4e47-a600-f1f97b330d14 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1668 microversion: 2.1 time: 0.176442 Dec 17 13:14:27.862999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1413/2830] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:14:27 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:09.440951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:15:09.441706 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:15:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:15:10.652035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:15:10.652676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:15:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:15:31.457994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:31.460143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:31.468467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.468835 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.469676 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.470096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.503970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-407e2c0c-aa32-4e81-8da5-958c9d03551e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052891 Dec 17 13:15:31.504592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1418/2831] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 13:15:31 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:31.579596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:31.580284 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:31.586500 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.587460 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.587908 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.588851 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.629184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:15:31.733641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b0e4215c-3168-4303-858b-b0486c6106c5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 204 len: 0 microversion: 2.1 time: 0.158517 Dec 17 13:15:31.734549 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1414/2832] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:15:31 2021] DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:15:31.746571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:31.747755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:31.757444 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.757917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.758749 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:31.759215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:31.908731 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:31.917058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3eba94a9-a7a1-4be8-9e6e-e9f49ad71aeb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1674 microversion: 2.1 time: 0.176824 Dec 17 13:15:31.917692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1419/2833] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:31 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:32.934413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:32.935015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:32.942365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:32.942860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:32.943656 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:32.944148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:33.100191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:33.109451 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cdcd0ff0-50ce-4b40-85b9-dbb2dc75e477 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1674 microversion: 2.1 time: 0.178824 Dec 17 13:15:33.110278 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1415/2834] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:32 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:34.073443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-a3b3ddaa-a573-4910-9303-cf33bc05df5b req-c7259cce-4627-420e-a29d-db057ec426f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b87a26d-6193-43d4-918a-92bb8c942c88", "name": "network-vif-deleted", "tag": "269db193-f1d9-4700-81ea-793b7085b762"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:34.077821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:15:34.077821 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:15:34.088351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a3b3ddaa-a573-4910-9303-cf33bc05df5b req-c7259cce-4627-420e-a29d-db057ec426f8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:34.088811 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a3b3ddaa-a573-4910-9303-cf33bc05df5b req-c7259cce-4627-420e-a29d-db057ec426f8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:34.103440 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-a3b3ddaa-a573-4910-9303-cf33bc05df5b req-c7259cce-4627-420e-a29d-db057ec426f8 service nova] Creating event network-vif-deleted:269db193-f1d9-4700-81ea-793b7085b762 for instance 8b87a26d-6193-43d4-918a-92bb8c942c88 on hv-cinder-80152 Dec 17 13:15:34.111457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-a3b3ddaa-a573-4910-9303-cf33bc05df5b req-c7259cce-4627-420e-a29d-db057ec426f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046549 Dec 17 13:15:34.112391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1420/2835] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:15:34.137452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:34.139708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:34.159159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:34.159623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:34.161238 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:34.161923 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:34.244971 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:34.255302 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f9bb9297-1a2c-4afe-b5e0-69c10e461476 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 200 len: 1323 microversion: 2.1 time: 0.129200 Dec 17 13:15:34.256395 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1416/2836] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:34 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 1323 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 17 13:15:35.278968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:35.280395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:35.290111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:35.290898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:35.291948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:35.292585 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:35.306668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. Dec 17 13:15:35.307329 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:15:35.308227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-76e64aaf-ba8b-4d0e-b04b-8150c6c8385b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 404 len: 111 microversion: 2.1 time: 0.033520 Dec 17 13:15:35.308829 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1421/2837] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:35 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:15:35.317544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cf3bea71-471f-4f54-875a-eae054d5a49a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '.version_select at 0x7fba112abaf0>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:35.340095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cf3bea71-471f-4f54-875a-eae054d5a49a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052580289" status: 202 len: 0 microversion: 2.1 time: 0.026231 Dec 17 13:15:35.342693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1417/2838] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Dec 17 13:15:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052580289 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:15:36.016648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: .version_select at 0x7fba112084c0>, body: {"keypair": {"name": "tempest-keypair-22605053"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:36.030231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:15:36.033994 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:15:36.533568 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:15:36.537193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'key_pairs'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:15:36.550079 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-85fcface-6311-42bd-b756-6ae010f5a58b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.537396 Dec 17 13:15:36.550671 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1422/2839] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Dec 17 13:15:36 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:37.803532 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-229598772", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad5a099b-4879-4e6b-97ab-1f857652d3ac"}], "security_groups": [{"name": "tempest-securitygroup--1172184260"}], "key_name": "tempest-keypair-22605053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:37.913164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] validate_networks() for [('ad5a099b-4879-4e6b-97ab-1f857652d3ac', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:15:38.284731 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:15:38.285151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:15:38.285651 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:15:38.286060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:15:38.286471 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:15:38.295605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:38.296058 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:38.296929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:38.297413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:38.313986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for project 14493b9933ea4389a09a481df0b5244c. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:15:38.318045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Getting quotas for user bc5ffad9e9494f9696dce7582b6f2f93 and project 14493b9933ea4389a09a481df0b5244c. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:15:38.329672 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:15:38.332054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:15:38.381308 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9fa201ba-1036-40a9-95a9-c07b458a7002 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585623 Dec 17 13:15:38.381958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1418/2840] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:15:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:15:38.392067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e59a90d-526c-4a85-a433-69b53887114b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:38.392626 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2e59a90d-526c-4a85-a433-69b53887114b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:38.447097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2e59a90d-526c-4a85-a433-69b53887114b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:38.454817 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e59a90d-526c-4a85-a433-69b53887114b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1235 microversion: 2.1 time: 0.066470 Dec 17 13:15:38.464631 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1423/2841] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:38 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:39.473095 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:39.473956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:39.480822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:39.481303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:39.482097 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:39.482528 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:39.550497 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:39.558707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7860dab4-5c95-41e1-afc8-5d31a71c6b48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1293 microversion: 2.1 time: 0.090276 Dec 17 13:15:39.559304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1419/2842] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:39 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:40.575949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:40.577181 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:40.584424 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:40.584878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:40.585692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:40.586138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:40.767820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-667d0b6b-4b58-45f4-a5c8-35cb6d4b5b8f req-87f5b6b5-61cf-4eca-b34b-4f76098abf56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2", "tag": "1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:40.769697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:15:40.769697 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:15:40.779048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-667d0b6b-4b58-45f4-a5c8-35cb6d4b5b8f req-87f5b6b5-61cf-4eca-b34b-4f76098abf56 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:40.780282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-667d0b6b-4b58-45f4-a5c8-35cb6d4b5b8f req-87f5b6b5-61cf-4eca-b34b-4f76098abf56 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:40.793935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-667d0b6b-4b58-45f4-a5c8-35cb6d4b5b8f req-87f5b6b5-61cf-4eca-b34b-4f76098abf56 service nova] Creating event network-changed:1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd for instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 on hv-cinder-80152 Dec 17 13:15:40.799554 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-667d0b6b-4b58-45f4-a5c8-35cb6d4b5b8f req-87f5b6b5-61cf-4eca-b34b-4f76098abf56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041316 Dec 17 13:15:40.800428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1420/2843] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:15:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:15:40.842160 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:40.851421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9d9d4db2-837f-478c-ab37-f7962e498427 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.279291 Dec 17 13:15:40.852005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1424/2844] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:40 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:41.868801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:41.869525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:41.876002 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:41.876506 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:41.877251 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:41.877706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:42.009380 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:42.016700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f61058bd-80cf-4f4f-ae40-f1aeab12fcd1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.152341 Dec 17 13:15:42.017328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1421/2845] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:41 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:43.033637 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:43.034242 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:43.040957 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:43.041429 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:43.042196 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:43.042959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:43.175307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:43.183515 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-534dcc67-aed6-4799-b29d-2bbeb6d14ec5 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.153645 Dec 17 13:15:43.184090 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1425/2846] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:43 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:44.200488 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:44.201093 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:44.208252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:44.208691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:44.209588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:44.210013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:44.348049 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:44.355936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-841cc4c6-f74a-4085-aa58-d1f82ac65a9a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.159216 Dec 17 13:15:44.356503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1422/2847] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:44 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:45.371953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:45.372566 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:45.379525 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:45.379971 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:45.380756 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:45.381188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:45.519596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:45.527250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-68b97ef0-dda2-4348-8e1c-eaad722490f1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.158990 Dec 17 13:15:45.527840 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1426/2848] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:45 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:45.772622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-466e9b09-f618-4faa-89ae-d59b8e334499 req-0bf86ef7-c7cd-4db5-94f3-3fa6967f5dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2", "name": "network-vif-plugged", "status": "completed", "tag": "1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:45.774406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:15:45.774406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:15:45.783522 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-466e9b09-f618-4faa-89ae-d59b8e334499 req-0bf86ef7-c7cd-4db5-94f3-3fa6967f5dc9 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:45.784008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-466e9b09-f618-4faa-89ae-d59b8e334499 req-0bf86ef7-c7cd-4db5-94f3-3fa6967f5dc9 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:45.798988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-466e9b09-f618-4faa-89ae-d59b8e334499 req-0bf86ef7-c7cd-4db5-94f3-3fa6967f5dc9 service nova] Creating event network-vif-plugged:1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd for instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 on hv-cinder-80152 Dec 17 13:15:45.807382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-466e9b09-f618-4faa-89ae-d59b8e334499 req-0bf86ef7-c7cd-4db5-94f3-3fa6967f5dc9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038502 Dec 17 13:15:45.807996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1423/2849] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:15:46.544105 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:46.544727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:46.551972 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:46.552412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:46.553174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:46.553729 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:46.694136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:46.702004 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f10cdfb0-7d59-4e34-82ce-4353a8a23811 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1361 microversion: 2.1 time: 0.161654 Dec 17 13:15:46.702573 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1427/2850] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:46 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:47.720112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:47.720849 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:47.727759 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:47.728200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:47.728963 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:47.729425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:47.861792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:15:47.870386 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d043e310-c292-43d6-ae62-36c38686c17c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1546 microversion: 2.1 time: 0.154956 Dec 17 13:15:47.870968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1424/2851] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:15:47 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:15:47.886435 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:15:47.887021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:47.893627 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:47.894069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:47.894842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:47.895263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:47.977120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8a57181a-154a-4f3c-9a8c-8aabb6557ed4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094260 Dec 17 13:15:47.977752 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1428/2852] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Dec 17 13:15:47 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:15:48.935307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:48.936236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:48.942680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-a25bfca1-f1e7-4e08-98bf-3d9d959c8277 req-4160b05d-b284-40f2-bbc1-8473f6551caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2", "tag": "1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:48.944206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:15:48.944206 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:15:48.951198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:48.951803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:48.952598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:48.953211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:48.954234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a25bfca1-f1e7-4e08-98bf-3d9d959c8277 req-4160b05d-b284-40f2-bbc1-8473f6551caf service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:48.954914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a25bfca1-f1e7-4e08-98bf-3d9d959c8277 req-4160b05d-b284-40f2-bbc1-8473f6551caf service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:48.966182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-a25bfca1-f1e7-4e08-98bf-3d9d959c8277 req-4160b05d-b284-40f2-bbc1-8473f6551caf service nova] Creating event network-changed:1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd for instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 on hv-cinder-80152 Dec 17 13:15:48.971304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-a25bfca1-f1e7-4e08-98bf-3d9d959c8277 req-4160b05d-b284-40f2-bbc1-8473f6551caf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032740 Dec 17 13:15:48.972261 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1429/2853] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:15:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:15:49.013892 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ba495b2-66f4-41c9-82a3-c9143aeefffb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.082196 Dec 17 13:15:49.015023 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1425/2854] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:48 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:50.027066 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:50.028083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:50.036528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:50.037201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:50.038229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:50.038664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:50.096839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c31ef85d-3bce-4036-bdb4-c2d56766aa56 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.074569 Dec 17 13:15:50.097876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1430/2855] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:50 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:51.109206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:51.110161 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:51.117667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:51.118113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:51.118901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:51.119328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:51.179507 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-915d4529-43bc-4602-9bae-bac963de1cdb tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.074390 Dec 17 13:15:51.180245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1426/2856] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:51 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:52.191896 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:52.192786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:52.200813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:52.201264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:52.202080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:52.202503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:52.263094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-afe51f69-bef0-40ea-b9fa-914a3ee897d8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.075462 Dec 17 13:15:52.263733 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1431/2857] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:52 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:53.274901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:53.275901 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:53.283336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:53.283816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:53.284595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:53.285025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:53.349321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-09034eb0-1c69-43c4-b5bf-376d1d95bd95 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.078378 Dec 17 13:15:53.349999 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1427/2858] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:53 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:54.361168 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:54.362207 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:54.369503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:54.369954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:54.370740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:54.371179 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:54.430383 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-95d16082-fbb2-41dd-8003-857fd0e408a7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.073145 Dec 17 13:15:54.431088 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1432/2859] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:54 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:55.442785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:55.443784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:55.450878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:55.451315 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:55.452084 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:55.452503 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:55.512621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c60ae178-b8f4-4d1a-95fa-276634756986 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.073725 Dec 17 13:15:55.513258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1428/2860] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:55 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:56.524518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:56.525542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:56.533007 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:56.533489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:56.534276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:56.534701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:56.611389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f2d8cdd8-a249-4ee7-b1d7-3645c89c057a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.090443 Dec 17 13:15:56.612404 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1433/2861] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:56 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:57.624206 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:57.625298 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:57.632846 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:57.633307 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:57.634141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:57.634580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:57.695930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-390082bf-e24d-4e00-9f20-04e73f11fd07 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.075634 Dec 17 13:15:57.696591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1429/2862] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:57 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:58.707743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:58.708726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:58.716198 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:58.716641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:58.717441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:58.717869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:58.778670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5e0bd057-19b0-4db4-9448-ffa4737a6889 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 14 microversion: 2.1 time: 0.074853 Dec 17 13:15:58.779546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1434/2863] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:58 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:15:59.790796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:15:59.791828 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:15:59.799171 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:59.799617 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:59.800403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:15:59.800835 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:15:59.871926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ef0ebb4c-0c57-4d34-b5d0-0afb88fa8769 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 9709 microversion: 2.1 time: 0.085069 Dec 17 13:15:59.872583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1430/2864] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:15:59 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 9709 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:00.884003 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:00.885083 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:00.893230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:00.893714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:00.894496 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:00.894930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:00.963477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-fc88f5cd-19aa-412b-bcfc-08a12bad28e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 17459 microversion: 2.1 time: 0.083810 Dec 17 13:16:00.964153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1435/2865] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:00 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 17459 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:01.976235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:01.977163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:01.986030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:01.986663 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:01.987453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:01.987997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:02.066942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-17ef54fc-defa-43d5-aac3-05e434814d6a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 18777 microversion: 2.1 time: 0.095045 Dec 17 13:16:02.067577 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1431/2866] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:01 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 18777 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:03.081365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:03.082603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:03.090443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:03.090890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:03.091683 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:03.092122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:03.199998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-82aa1c9c-0182-4506-a80f-73b8a733e2af tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 21519 microversion: 2.1 time: 0.124198 Dec 17 13:16:03.200882 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1436/2867] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:03 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 21519 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:04.212331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:04.213230 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:04.221842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:04.222283 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:04.223468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:04.223902 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:04.300153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-bd82e29f-4f6e-4302-af39-d04b78d95609 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 23228 microversion: 2.1 time: 0.091919 Dec 17 13:16:04.300816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1432/2868] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:04 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 23228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:05.318786 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:05.320244 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:05.330664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:05.331122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:05.331935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:05.332375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:05.405814 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-65ec1980-b6c9-40fb-8e1f-74e744276517 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 24627 microversion: 2.1 time: 0.092965 Dec 17 13:16:05.406578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1437/2869] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:05 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 24627 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:06.419312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:06.420314 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:06.427709 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:06.428152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:06.428953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:06.429414 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:06.512670 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-86dbf84b-7c9e-4196-942e-b308168c0205 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 26282 microversion: 2.1 time: 0.097429 Dec 17 13:16:06.513328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1433/2870] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:06 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 26282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:07.526991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:07.528657 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:07.539330 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:07.539973 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:07.541080 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:07.541747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:07.660300 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dbc0107f-a056-41da-99e9-c187ef45083d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 27553 microversion: 2.1 time: 0.138760 Dec 17 13:16:07.660968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1438/2871] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:07 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 27553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:08.673667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:08.675113 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:08.683711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:08.684189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:08.684951 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:08.685439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:08.762221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-73ba6df8-5519-4f9a-bd18-166427f068e3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 27906 microversion: 2.1 time: 0.092938 Dec 17 13:16:08.762874 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1434/2872] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:08 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 27906 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:09.774828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:09.775859 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:09.783745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:09.784283 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:09.785064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:09.785623 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:09.868350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ed1040cf-6126-44dd-b7ce-8b61dcb1e68b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.097316 Dec 17 13:16:09.869120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1439/2873] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:09 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:10.881191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:10.882286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:10.892154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:10.892622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:10.893712 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:10.894403 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:10.968033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a3e60382-b632-4bc6-8cbf-235c32f0ce5b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.090999 Dec 17 13:16:10.968720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1435/2874] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:10 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:11.983465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:11.984561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:11.991872 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:11.992322 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:11.993127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:11.993592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:12.054319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-02edebdc-9fbd-4f34-bb97-5c7eaa431344 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.076397 Dec 17 13:16:12.054984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1440/2875] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:11 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 13:16:13.066786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:13.067804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:13.077536 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:13.077907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:13.078808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:13.079271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:13.161937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d36ddbfd-8a6c-454f-a64a-3d512c6bc51e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.099171 Dec 17 13:16:13.162682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1436/2876] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:13 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:14.176129 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:14.177072 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:14.184946 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:14.185441 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:14.186251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:14.186692 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:14.251803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-53d225f3-8c47-4c49-844d-b80d57cc23c6 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.079803 Dec 17 13:16:14.252803 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1441/2877] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:14 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:15.265736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:15.266658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:15.274201 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:15.274683 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:15.275537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:15.276027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:15.352719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a044ef3c-798b-4947-b9f2-b0543809c5a2 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.090630 Dec 17 13:16:15.353640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1437/2878] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:15 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:16.367909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:16.368974 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:16.376478 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:16.376970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:16.377825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:16.378231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:16.444554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-736a656e-5427-490b-9bc4-ff95b27bcd71 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.080729 Dec 17 13:16:16.445247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1442/2879] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:16 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:17.457204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:17.458172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:17.465659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:17.466107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:17.466966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:17.467354 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:17.539330 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-85af4dcc-9353-450d-8cc1-7144587e5d40 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.086170 Dec 17 13:16:17.540017 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1438/2880] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:17 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:18.551949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:18.552944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:18.560269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:18.560720 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:18.561554 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:18.561980 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:18.628213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-73755ada-e9b1-42c4-a8b0-196c7ae418d1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.080263 Dec 17 13:16:18.628901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1443/2881] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:18 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:19.641695 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:19.642792 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:19.650639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:19.651080 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:19.651842 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:19.652265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:19.715054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7f80aebe-d98e-4f6b-b0f5-c074478b0111 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.077829 Dec 17 13:16:19.715941 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1439/2882] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:19 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:20.730625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:20.731628 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:20.738899 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:20.739340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:20.740137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:20.740561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:20.804215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ff39b375-61d4-4535-af9a-531bb53ec643 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.078501 Dec 17 13:16:20.804909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1444/2883] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:20 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:21.821969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:21.823474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:21.834993 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:21.835779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:21.837205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:21.837659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:21.900271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-663884d8-5660-4b4f-9606-ab6b379e72fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28202 microversion: 2.1 time: 0.085321 Dec 17 13:16:21.900946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1440/2884] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:21 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:22.915076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:22.916133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:22.923565 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:22.924006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:22.924772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:22.925195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:23.003443 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3ea92b17-f854-45b9-8ec0-265e48cbb11d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28493 microversion: 2.1 time: 0.093102 Dec 17 13:16:23.004092 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1445/2885] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:22 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28493 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:23.512761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:23.513324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:23.520623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:23.521068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:23.521887 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:23.522320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:23.545843 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lazy-loading 'flavor' on Instance uuid 44ba4cff-5951-40ca-bd3f-cd6c1667708e {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:16:23.621681 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a15d6aa6-0551-4cf9-bf90-d29f585a09ef tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "POST /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e/action" status: 202 len: 0 microversion: 2.1 time: 0.113792 Dec 17 13:16:23.622352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1441/2886] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:23 2021] POST /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:16:23.631143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:23.631842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:23.639147 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:23.639748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:23.640579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:23.641078 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:23.779388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:23.787167 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8f2f9917-363d-45cb-9877-1568f91554dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.160080 Dec 17 13:16:23.787727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1446/2887] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:23 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:24.017292 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:24.018377 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:24.025371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:24.025820 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:24.026594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:24.027014 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:24.089306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1e41c393-9945-4519-99a3-2b4d665e47bc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28493 microversion: 2.1 time: 0.076922 Dec 17 13:16:24.089895 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1442/2888] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:24 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28493 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:24.804745 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:24.805368 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:24.812466 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:24.812941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:24.813760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:24.814194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:24.956453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:24.968056 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2acbd27e-066b-406a-837f-1f8c03e80353 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.166733 Dec 17 13:16:24.968816 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1447/2889] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:24 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:25.103723 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:25.104635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:25.111927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:25.112346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:25.113192 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:25.113660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:25.196107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a66d2512-ab0b-4094-bc9e-c0f06bed92f9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.098504 Dec 17 13:16:25.197211 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1443/2890] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:25 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:25.988962 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:25.989602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:25.996185 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:25.996621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:25.997413 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:25.997862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:26.142405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:26.150825 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dcb38854-7e89-44cb-9843-26a4a6b44265 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.165575 Dec 17 13:16:26.151408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1448/2891] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:25 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:26.212222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:26.213550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:26.221074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:26.221559 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:26.222335 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:26.222762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:26.289860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7beb2d61-4d82-4ded-afbb-6bd4ef4ac153 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.084238 Dec 17 13:16:26.290518 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1444/2892] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:26 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:27.170027 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:27.170654 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:27.177355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:27.177956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:27.178770 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:27.179209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:27.304056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:27.305258 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:27.312605 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:27.313019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:27.313848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:27.314408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:27.319039 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:27.326750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9e0e1621-2453-4479-a3ed-dd07c09fa9aa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.161679 Dec 17 13:16:27.327318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1449/2893] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:27 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:27.375563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5820a93e-d5db-4eea-94ef-fcf2e96ea446 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.075380 Dec 17 13:16:27.376336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1445/2894] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:27 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 17 13:16:28.353228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:28.354335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:28.363085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:28.363528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:28.364305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:28.364735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:28.389956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:28.390953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:28.398831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:28.399276 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:28.400060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:28.400486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:28.460745 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cdc0da47-42c4-4922-9a3d-8d6eba0f1d49 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.074976 Dec 17 13:16:28.461433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1446/2895] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:28 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:28.500564 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:28.509510 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c91738a6-8cf1-4c1b-b0f2-1f1835689e40 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.163347 Dec 17 13:16:28.510151 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1450/2896] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:28 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:29.472986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:29.474509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:29.483921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:29.484363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:29.485147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:29.485604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:29.534157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:29.534758 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:29.544343 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:29.545005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:29.546208 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:29.546753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:29.548353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-21f2a0de-c375-4dd0-a73f-b70dbb1650f8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.079276 Dec 17 13:16:29.549516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1447/2897] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:29 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:29.683916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:29.694126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a805eb6d-729f-4430-932b-ccafc8426957 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.165713 Dec 17 13:16:29.694942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1451/2898] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:29 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:30.563961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:30.564975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:30.572537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:30.572975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:30.573784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:30.574208 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:30.640193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5a8e3cb1-f1e7-47d0-8319-487d930b1f7f tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.081098 Dec 17 13:16:30.640979 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1448/2899] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:30 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:30.711590 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:30.712249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:30.719189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:30.719636 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:30.720488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:30.720923 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:30.866215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:30.874135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f79c6dbe-8720-4b91-9db5-82890092d5dc tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.166358 Dec 17 13:16:30.874718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1452/2900] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:30 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:31.656875 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:31.658430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:31.669123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:31.669591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:31.670648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:31.671310 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:31.745389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff004283-a787-4605-9238-0aad83596cfe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.094985 Dec 17 13:16:31.746055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1449/2901] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:31 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:31.895539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:31.896390 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:31.907753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:31.908904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:31.909578 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:31.910012 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:32.066519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:32.074741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-59dc92ed-8326-412a-82e2-94f9ae24d94d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.185527 Dec 17 13:16:32.075314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1453/2902] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:31 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:32.759946 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:32.761079 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:32.768962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:32.769442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:32.770218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:32.770652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:32.836632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2fe49f25-0c0a-4fcc-a2b7-5af6c94e173d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.082703 Dec 17 13:16:32.838114 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1450/2903] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:32 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:33.096352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:33.097501 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:33.108876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:33.109598 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:33.110874 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:33.111580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:33.254256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:33.265648 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-70ca140e-cf69-4967-af9e-ec8b04599c4e tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.175281 Dec 17 13:16:33.266420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1454/2904] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:33 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:33.849455 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:33.850494 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:33.857234 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:33.857711 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:33.858486 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:33.858905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:33.921030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ff737029-0968-45dc-85d1-4195cc40a3b1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.075765 Dec 17 13:16:33.921785 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1451/2905] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:33 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:34.283638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:34.284308 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:34.292439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:34.292934 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:34.293769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:34.294209 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:34.440863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:34.449442 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-3a469b98-d1db-4ce3-809e-34c9f86e2363 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.169821 Dec 17 13:16:34.450118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1455/2906] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:34 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:34.938081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:34.939748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:34.947740 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:34.948184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:34.948965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:34.949434 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:35.014676 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d6033b8a-a83c-4609-b85d-8ac7d7da1f0e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.083140 Dec 17 13:16:35.015425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1452/2907] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:34 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:35.468680 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:35.469256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:35.476351 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:35.476791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:35.477610 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:35.478028 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:35.616713 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:35.628595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-63734657-79aa-4b20-a095-584ef81d6fcd tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.163482 Dec 17 13:16:35.629576 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1456/2908] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:35 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:36.029736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:36.030758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:36.038122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.038572 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.039401 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.039827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.100948 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c3e5d8a9-094b-4a51-a689-020617d26c46 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.075096 Dec 17 13:16:36.101646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1453/2909] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:36 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:36.649355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:36.649943 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:36.656863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.657318 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.658123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.658591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.798665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:36.806748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a159d930-8efa-4345-8b1f-6e14f6384be0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1569 microversion: 2.1 time: 0.162849 Dec 17 13:16:36.807326 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1457/2910] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:36 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:36.823419 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:36.824094 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:36.831446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.831928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.832729 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.833160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.932639 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3b983006-d37b-451a-8863-16d273c60ade tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "POST /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e/action" status: 202 len: 0 microversion: 2.1 time: 0.113274 Dec 17 13:16:36.933182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1454/2911] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:36 2021] POST /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:16:36.941344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:36.942127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:36.948684 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.949190 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:36.950125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:36.950531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:37.086502 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:37.094093 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-34f7f3b3-8539-4a8b-bca2-a7521061cafa tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1517 microversion: 2.1 time: 0.156604 Dec 17 13:16:37.094673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1458/2912] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:36 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:37.113832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:37.114738 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:37.122930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:37.123374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:37.124126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:37.124547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:37.187520 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-124a1ad8-a624-48d8-b867-02b7ed3d44b3 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.077663 Dec 17 13:16:37.188602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1455/2913] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:37 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:38.111794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:38.112324 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:38.119307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:38.119750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:38.120507 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:38.120926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:38.200808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:38.201210 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:38.208371 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:38.208816 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:38.209629 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:38.210098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:38.258948 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:38.268118 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-28cad53b-351a-48ab-b90c-bb131284f2ed tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1517 microversion: 2.1 time: 0.160178 Dec 17 13:16:38.268732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1459/2914] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:38 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:38.281928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-af81703a-a2ff-4ca1-b68f-99c91fa3e3e9 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.085655 Dec 17 13:16:38.282949 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1456/2915] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:38 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:39.285473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:39.286220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:39.295029 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:39.296242 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:39.296365 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:39.296919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:39.298178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:39.298794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:39.306502 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:39.306940 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:39.307715 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:39.308140 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:39.369935 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b6bef5fa-8c2e-4adb-9165-127381195b45 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.079480 Dec 17 13:16:39.374591 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1457/2916] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:39 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:39.443499 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:39.454467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-75c20670-5c99-47c5-8e6b-17174e3ad5d8 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1517 microversion: 2.1 time: 0.172706 Dec 17 13:16:39.455054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1460/2917] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:39 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:39.990832 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-c19a0fee-199c-4071-bcb9-92ba9a7c4200 req-cf9f76d2-563b-4ff5-9e48-297ff282d30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "name": "network-vif-unplugged", "status": "completed", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:39.992338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:16:39.992338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:16:40.001421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c19a0fee-199c-4071-bcb9-92ba9a7c4200 req-cf9f76d2-563b-4ff5-9e48-297ff282d30c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:40.001871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-c19a0fee-199c-4071-bcb9-92ba9a7c4200 req-cf9f76d2-563b-4ff5-9e48-297ff282d30c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:40.012920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.compute.server_external_events [req-c19a0fee-199c-4071-bcb9-92ba9a7c4200 req-cf9f76d2-563b-4ff5-9e48-297ff282d30c service nova] Unable to find a host for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e. Dropping event network-vif-unplugged {{(pid=127716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 17 13:16:40.013872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-c19a0fee-199c-4071-bcb9-92ba9a7c4200 req-cf9f76d2-563b-4ff5-9e48-297ff282d30c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027301 Dec 17 13:16:40.014468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1458/2918] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:16:39 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 17 13:16:40.382763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:40.383738 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:40.390567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:40.391014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:40.391792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:40.392224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:40.451043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ca6f5df4-8aba-48bb-b35e-8c5274ec2f27 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.071830 Dec 17 13:16:40.451664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1461/2919] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:40 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:40.472293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:40.474150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:40.481867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:40.482293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:40.483073 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:40.483498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:40.617081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:40.625348 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dcbbe1e6-3124-448d-b1ca-1eaaefe092d7 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1517 microversion: 2.1 time: 0.157156 Dec 17 13:16:40.625955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1459/2920] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:40 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:41.466529 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:41.467641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:41.475388 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:41.475860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:41.476634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:41.477069 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:41.545954 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d6c8b364-b0a5-4bde-98a6-193609f2dcac tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.085029 Dec 17 13:16:41.546587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1462/2921] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:41 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:41.643803 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:41.644418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:41.652291 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:41.652748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:41.653609 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:41.654044 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:41.815799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:41.825998 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0d35987e-059b-40c5-992d-2eea8d38aad1 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1517 microversion: 2.1 time: 0.186284 Dec 17 13:16:41.826655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1460/2922] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:41 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:42.557903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:42.558938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:42.567866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:42.568311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:42.569084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:42.569541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:42.638575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7503ebf7-1049-4671-aa5f-aeba8ae98d21 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.084654 Dec 17 13:16:42.639234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1463/2923] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:42 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:42.844611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:42.845364 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:42.853226 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:42.853673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:42.854509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:42.854988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:42.995415 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:43.003152 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3bd3f2e9-2f70-4cc0-a459-9a700de21e1b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.162736 Dec 17 13:16:43.003735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1461/2924] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:42 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:43.653613 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:43.654649 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:43.662038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:43.662486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:43.663262 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:43.663696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:43.952991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ed9b8f50-dc4e-4533-bb4e-c30aed7a4940 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.304440 Dec 17 13:16:43.953711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1464/2925] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:43 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:44.020748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:44.021433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:44.028702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:44.029144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:44.029968 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:44.030404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:44.178466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:44.190369 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-120f7035-5053-4745-99ca-887a79a2a3df tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.172992 Dec 17 13:16:44.191253 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1462/2926] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:44 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:44.303396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:16:44.303743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:16:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:16:44.967145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:44.968152 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:44.976289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:44.976721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:44.977592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:44.977988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:45.043696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-beab7274-ba46-4f6b-8233-665e07485bd0 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.080534 Dec 17 13:16:45.044363 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1465/2927] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:44 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:45.214032 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:45.214855 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:45.221597 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:45.222055 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:45.222815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:45.223244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:45.369850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:45.377905 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0709a0b5-2ef5-4f9a-9292-f382dbccf869 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.170133 Dec 17 13:16:45.378474 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1463/2928] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:45 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:46.056831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:46.058237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:46.065553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:46.066002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:46.066788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:46.067250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:46.128349 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1227f12d-cf44-47ca-804a-693061d6d0cd tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.075326 Dec 17 13:16:46.128792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1466/2929] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:46 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:46.398054 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:46.398630 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:46.406189 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:46.406649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:46.407504 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:46.407996 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:46.564557 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:46.572351 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9f4ed50b-bfde-4536-ba3c-d26330eec7e0 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.178319 Dec 17 13:16:46.572930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1464/2930] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:46 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:47.140878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:47.141888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:47.149405 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:47.149849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:47.150632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:47.151057 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:47.214157 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-18ba8ee9-cad5-43b6-9173-b2c745da8733 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.077418 Dec 17 13:16:47.214867 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1467/2931] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:47 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:47.589602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:47.590241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:47.596922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:47.597370 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:47.598172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:47.598599 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:47.735154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:47.743418 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9ed4f9db-cf29-44bd-806b-b89728ac5bdb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.157709 Dec 17 13:16:47.744104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1465/2932] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:47 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:48.228334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:48.229361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:48.237229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:48.237705 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:48.238487 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:48.238916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:48.305708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a724de49-a4eb-4470-96cf-92dcf7359449 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.081502 Dec 17 13:16:48.306247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1468/2933] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:48 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:48.760665 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:48.761243 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:48.768196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:48.768638 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:48.769457 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:48.769883 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:48.905604 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:48.913598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0b2d89f5-3160-45b3-b12e-04c4d0048a73 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.156685 Dec 17 13:16:48.914170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1466/2934] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:48 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:49.318249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:49.319241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:49.327271 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:49.327709 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:49.328481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:49.328904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:49.397205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7174824e-210e-4bc1-9b6a-6f8f1a249c6e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.082702 Dec 17 13:16:49.398084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1469/2935] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:49 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:49.932769 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:49.933777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:49.944156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:49.944777 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:49.946022 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:49.946911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:50.094391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:50.103339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d1af6e2-06c7-4f15-85c6-5c4682d35838 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.176509 Dec 17 13:16:50.103914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1467/2936] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:49 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:50.412034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:50.412950 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:50.420189 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:50.420638 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:50.421460 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:50.421897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:50.498726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-aa5f418a-18ac-481c-9f32-1c130e4b901d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.090721 Dec 17 13:16:50.499483 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1470/2937] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:50 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:51.120866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:51.121489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:51.128106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:51.128521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:51.129336 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:51.129782 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:51.275311 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:51.283588 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d639fba4-c924-433d-84e7-d37f580428ae tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.166783 Dec 17 13:16:51.284179 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1468/2938] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:51 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:51.511665 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:51.512601 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:51.519987 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:51.520453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:51.521230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:51.521695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:51.583043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4aa5b50a-2594-4144-b9f6-2296b506ed5a tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 28661 microversion: 2.1 time: 0.075343 Dec 17 13:16:51.583699 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1471/2939] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:51 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:52.306774 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:52.307610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:52.317834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:52.319527 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:52.319806 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:52.320544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:52.472476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:52.481363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a0f012f7-41ef-4711-a241-a69e647c040f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.180964 Dec 17 13:16:52.482153 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1469/2940] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:52 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:52.596264 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:52.597534 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:52.605240 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:52.605717 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:52.606509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:52.606939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:52.682243 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f6536ae0-5a9f-4132-9f46-6e625aa6461d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 30604 microversion: 2.1 time: 0.090015 Dec 17 13:16:52.683038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1472/2941] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:52 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 30604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:53.500229 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:53.500840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:53.507809 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:53.508264 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:53.509021 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:53.509479 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:53.646493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:53.654830 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7dcc97da-8c82-44fa-9bf1-5bc3598f3d87 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.158214 Dec 17 13:16:53.655470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1470/2942] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:53 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:53.697591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:53.698574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:53.706180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:53.706611 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:53.707396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:53.707824 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:53.779449 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-699a741f-9a84-4e3b-978b-bf60d666e9ad tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 32650 microversion: 2.1 time: 0.087730 Dec 17 13:16:53.780407 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1473/2943] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:53 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 32650 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:54.211461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-9dec9c51-780f-44c0-959c-c660f5afeb3a req-376e3078-ea4a-41ef-9a2f-41a2fc3d4793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "name": "network-vif-plugged", "status": "completed", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:54.213043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:16:54.213043 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:16:54.221177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9dec9c51-780f-44c0-959c-c660f5afeb3a req-376e3078-ea4a-41ef-9a2f-41a2fc3d4793 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:54.221652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-9dec9c51-780f-44c0-959c-c660f5afeb3a req-376e3078-ea4a-41ef-9a2f-41a2fc3d4793 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:54.234758 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-9dec9c51-780f-44c0-959c-c660f5afeb3a req-376e3078-ea4a-41ef-9a2f-41a2fc3d4793 service nova] Creating event network-vif-plugged:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:16:54.240819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-9dec9c51-780f-44c0-959c-c660f5afeb3a req-376e3078-ea4a-41ef-9a2f-41a2fc3d4793 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Dec 17 13:16:54.241655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1471/2944] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:16:54.674161 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:54.674881 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:54.682180 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:54.682617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:54.683400 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:54.683819 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:54.792372 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:54.793501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:54.800560 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:54.801005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:54.802010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:54.802271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:54.831381 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:54.839250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2e84464f-11e8-4bf3-9d65-56fba4330f8d tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.169295 Dec 17 13:16:54.839791 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1474/2945] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:54 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:54.898768 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4855c8f8-01a5-4f56-a102-855b52c3119b tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 33760 microversion: 2.1 time: 0.110367 Dec 17 13:16:54.899435 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1472/2946] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:54 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 33760 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:55.856064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:55.856747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:55.869387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:55.869841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:55.870634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:55.871073 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:55.912690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:55.913751 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:55.920574 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:55.921019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:55.921967 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:55.922398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:55.993534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5ba8e0b6-7dc7-49d4-bf63-d81549909882 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 34786 microversion: 2.1 time: 0.084664 Dec 17 13:16:55.995148 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1473/2947] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:55 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 34786 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:56.015220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:56.024339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c658fca8-8cb9-4fed-8119-d198bf3dbada tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1575 microversion: 2.1 time: 0.171855 Dec 17 13:16:56.025220 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1475/2948] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:55 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:57.006834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:57.007815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:57.015168 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:57.015641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:57.016422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:57.016848 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:57.043000 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:16:57.043603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:57.050395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:57.050849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:57.051639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:57.052074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:57.095779 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-8eae0e93-87ee-434a-a363-0a087d4a5709 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 35980 microversion: 2.1 time: 0.092988 Dec 17 13:16:57.097384 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1474/2949] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:57 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 35980 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:57.198687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:16:57.206650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d74e4eaf-a7d1-479c-b686-4f8a1af3b11f tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1562 microversion: 2.1 time: 0.167274 Dec 17 13:16:57.207218 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1476/2950] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:16:57 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:16:58.110932 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:58.111960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:58.119594 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:58.120001 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:58.120733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:58.121154 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:58.195771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-06296b17-8fd9-45cb-adac-558e1fdd1ea4 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 37768 microversion: 2.1 time: 0.090149 Dec 17 13:16:58.196886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1475/2951] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:58 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 37768 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:16:59.208352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:16:59.209307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:16:59.216233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:59.216675 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:59.217498 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:16:59.217930 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:16:59.294933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-dde7be56-3b07-400b-9910-abf25410a92e tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 38192 microversion: 2.1 time: 0.089885 Dec 17 13:16:59.295890 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1477/2952] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:16:59 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 38192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:17:00.309053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:00.310332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:00.317805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:00.318249 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:00.319040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:00.319464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:00.397891 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e08f3d4c-fcad-4f74-a38e-cbe2184e4e28 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 38192 microversion: 2.1 time: 0.093147 Dec 17 13:17:00.398582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1476/2953] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:17:00 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 38192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:17:01.412064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:01.413048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:01.421221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:01.422174 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:01.422911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:01.423341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:01.488953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-acd75fa5-e772-4ea1-8169-35bbca3811c8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 38192 microversion: 2.1 time: 0.080816 Dec 17 13:17:01.493304 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1478/2954] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:17:01 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 38192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:17:02.502920 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:02.504263 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:02.513736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:02.514328 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:02.515346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:02.516050 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:02.575005 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-52ae0b79-848f-434c-9e28-96251fe7ac37 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 38192 microversion: 2.1 time: 0.077370 Dec 17 13:17:02.575690 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1477/2955] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:17:02 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 38192 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:17:03.588226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:03.589387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:03.597467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:03.598037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:03.598916 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:03.599681 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:03.675219 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4bbd9df6-aa90-4b22-9ac5-6e5a1c841258 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action" status: 200 len: 38321 microversion: 2.1 time: 0.090997 Dec 17 13:17:03.675906 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1479/2956] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Dec 17 13:17:03 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/action => generated 38321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 17 13:17:03.686593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:03.687136 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:03.694476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:03.694921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:03.695698 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:03.696130 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:03.720331 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-e166f777-0b77-4b37-8f56-bd8b3c784d7c tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/ips" status: 200 len: 144 microversion: 2.1 time: 0.037761 Dec 17 13:17:03.720918 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1478/2957] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Dec 17 13:17:03 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:05.067050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4d9661f-ad51-4d44-9912-820187d5a357"}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:05.068191 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:05.076461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:05.076827 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:05.077653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:05.078082 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:05.350290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6b7c058c-649a-4532-bc70-aaf27e2c0da1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286928 Dec 17 13:17:05.355505 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1480/2958] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 13:17:05 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:12.854266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:12.855239 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:12.862010 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:12.862453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:12.863235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:12.863655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:12.894773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d19b19ca-d849-467b-9b12-d3cb523f9994 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Dec 17 13:17:12.895324 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1479/2959] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 13:17:12 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:12.907135 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:12.907730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:12.914195 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:12.914634 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:12.915417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:12.915839 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:12.947772 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-499ec786-9db1-441a-9260-119890a12c5d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357" status: 200 len: 194 microversion: 2.1 time: 0.045660 Dec 17 13:17:12.948594 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1481/2960] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Dec 17 13:17:12 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:14.282537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edb7160c-99b9-4699-a990-c50d78f14472"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:14.283612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:14.290452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:14.290898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:14.291687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:14.292117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:14.550720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0e8f169e-ff9d-4003-bb6a-77f87b62a371 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271851 Dec 17 13:17:14.551378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1480/2961] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Dec 17 13:17:14 2021] POST /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:17:22.058968 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:22.059909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:22.066900 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.067341 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.068119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.068518 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.100586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6a35690a-cc4b-44fd-9073-d8901bbe35ec tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044803 Dec 17 13:17:22.101414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1482/2962] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 13:17:22 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:22.295454 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:22.296066 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:22.302960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.303402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.304193 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.304623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.334652 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a205d98-0cc5-4e3b-bfcf-e20a30d82ffe tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357" status: 200 len: 194 microversion: 2.1 time: 0.043801 Dec 17 13:17:22.335282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1481/2963] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Dec 17 13:17:22 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:22.344828 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:22.345319 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:22.352339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.352679 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.353494 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:22.353937 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:22.438480 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lazy-loading 'services' on Instance uuid a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:17:22.513904 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-44768024-290a-449e-ade1-433d962a6c20 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357" status: 202 len: 0 microversion: 2.1 time: 0.172519 Dec 17 13:17:22.514546 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1483/2964] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 13:17:22 2021] DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/e4d9661f-ad51-4d44-9912-820187d5a357 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:17:23.627431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:23.628065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:23.634338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:23.634823 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:23.635611 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:23.636039 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:23.666421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9a91c692-b800-4d4e-bb1c-b9873bc7a875 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/edb7160c-99b9-4699-a990-c50d78f14472" status: 200 len: 194 microversion: 2.1 time: 0.043043 Dec 17 13:17:23.667045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1482/2965] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Dec 17 13:17:23 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/edb7160c-99b9-4699-a990-c50d78f14472 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:23.680299 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:23.680903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:23.687320 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:23.687763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:23.688516 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:23.688936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:23.767116 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lazy-loading 'services' on Instance uuid a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:17:23.838146 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5bc4e5fb-9636-47db-91a9-edd5eaf12fa7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/edb7160c-99b9-4699-a990-c50d78f14472" status: 202 len: 0 microversion: 2.1 time: 0.164261 Dec 17 13:17:23.838850 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1484/2966] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Dec 17 13:17:23 2021] DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments/edb7160c-99b9-4699-a990-c50d78f14472 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:17:25.006570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:25.007516 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:25.014886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.014886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.015408 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.015833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.047174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f04b6b1a-3a0e-4ec7-ae7d-c41438365983 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044380 Dec 17 13:17:25.047735 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1483/2967] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 13:17:25 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:17:25.152122 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:25.153559 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:25.160335 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.160774 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.161595 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.162025 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.191682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4a09bbe6-b457-487a-8ffd-b21a497d63e8 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044234 Dec 17 13:17:25.192241 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1485/2968] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Dec 17 13:17:25 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 17 13:17:25.259781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:25.259781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:25.265886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.266366 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.267203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.267644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.293144 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:17:25.376089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-493aca32-9247-44ae-a0e0-cd9f25940c15 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 204 len: 0 microversion: 2.1 time: 0.121490 Dec 17 13:17:25.377026 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1484/2969] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:17:25 2021] DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:17:25.385700 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:25.386434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:25.392558 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.393006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.393813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:25.394245 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:25.526175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:17:25.533836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-590ed5ca-4592-44d9-a702-3ecef879cdd7 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1670 microversion: 2.1 time: 0.152155 Dec 17 13:17:25.534426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1486/2970] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:25 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:17:26.552222 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:26.552894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:26.559642 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:26.560088 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:26.560876 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:26.561297 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:26.701721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:17:26.709897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5250dba4-735e-4b58-b7d6-70bf73a0c773 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1670 microversion: 2.1 time: 0.162484 Dec 17 13:17:26.710484 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1485/2971] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:26 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:17:27.728307 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:27.728936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:27.735728 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:27.736170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:27.736959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:27.737420 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:28.005969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:17:28.015002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1dfd1e5d-d122-4adf-b6ba-6ccac5aa5229 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1670 microversion: 2.1 time: 0.291295 Dec 17 13:17:28.015753 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1487/2972] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:27 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:17:28.526633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-af7a791b-6a96-4b29-91c6-1a141a604232 req-48a427ed-61ba-4a18-961b-c96cd9ca0ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2", "name": "network-vif-deleted", "tag": "1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:28.528194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:17:28.528194 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:17:28.536579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-af7a791b-6a96-4b29-91c6-1a141a604232 req-48a427ed-61ba-4a18-961b-c96cd9ca0ff1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:28.537101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-af7a791b-6a96-4b29-91c6-1a141a604232 req-48a427ed-61ba-4a18-961b-c96cd9ca0ff1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:28.551047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-af7a791b-6a96-4b29-91c6-1a141a604232 req-48a427ed-61ba-4a18-961b-c96cd9ca0ff1 service nova] Creating event network-vif-deleted:1ee47ec4-9af2-4175-87ae-4bdfbc3e1ddd for instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 on hv-cinder-80152 Dec 17 13:17:28.557048 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-af7a791b-6a96-4b29-91c6-1a141a604232 req-48a427ed-61ba-4a18-961b-c96cd9ca0ff1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033690 Dec 17 13:17:28.560863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1486/2973] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:17:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:17:29.034854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:29.035732 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:29.045268 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:29.046246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:29.047389 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:29.048051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:29.088858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:29.089511 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:29.090192 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lazy-loading 'fault' on Instance uuid a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:17:29.136256 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5ffad9e9494f9696dce7582b6f2f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14493b9933ea4389a09a481df0b5244c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:17:29.145023 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-84f13164-d87d-4b70-985e-9940abec2a7d tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 200 len: 1325 microversion: 2.1 time: 0.115795 Dec 17 13:17:29.145938 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1488/2974] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:29 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 1325 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:17:30.162981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:30.163669 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:30.170654 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:30.171141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:30.171910 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:30.172333 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:30.186537 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. Dec 17 13:17:30.187132 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:17:30.187962 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-dcbc62d4-2d46-4e32-97fc-8e49a8012f90 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 404 len: 111 microversion: 2.1 time: 0.029055 Dec 17 13:17:30.188521 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1487/2975] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:30 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:17:30.197133 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2a699298-1844-45c0-a7d8-e9f7683ea978 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '.version_select at 0x7fba11d845e0>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:30.216136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2a699298-1844-45c0-a7d8-e9f7683ea978 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22605053" status: 202 len: 0 microversion: 2.1 time: 0.022707 Dec 17 13:17:30.216725 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1489/2976] 10.222.0.45 () {58 vars in 1214 bytes} [Fri Dec 17 13:17:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22605053 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:17:33.211748 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:33.212288 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:33.219015 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:33.219462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:33.220233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:33.220664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:33.234775 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. Dec 17 13:17:33.235373 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:17:33.236218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1c2884c7-ff9d-4a47-85b2-63754401e5c1 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 404 len: 111 microversion: 2.1 time: 0.028176 Dec 17 13:17:33.236786 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1488/2977] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:17:33 2021] DELETE /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:17:33.245310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:33.245976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:33.252908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:33.253380 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:33.254187 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:33.254621 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:33.268721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. Dec 17 13:17:33.269328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:17:33.270175 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-849b15f7-5b71-4efb-bd4d-d8622be63191 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2" status: 404 len: 111 microversion: 2.1 time: 0.028679 Dec 17 13:17:33.270755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1490/2978] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:33 2021] GET /compute/v2.1/servers/a4b6b84a-fc4b-404f-a53a-a5f4b79a9fd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:17:34.401863 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:34.402432 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:34.409129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:34.409612 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:34.410404 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:34.410864 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:34.427352 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. Dec 17 13:17:34.427981 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:17:34.428861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-45d296b6-4b1f-4533-b384-086cecd0cc48 tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 404 len: 111 microversion: 2.1 time: 0.030738 Dec 17 13:17:34.429509 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1489/2979] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:17:34 2021] DELETE /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:17:34.438339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:34.439002 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] [instance: 8b87a26d-6193-43d4-918a-92bb8c942c88] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:34.446226 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:34.446668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:34.447475 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:34.447901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:34.461640 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] HTTP exception thrown: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. Dec 17 13:17:34.462251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] Returning 404 to user: Instance 8b87a26d-6193-43d4-918a-92bb8c942c88 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:17:34.463085 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4e5f8da4-7599-4b05-9a3c-81e00ffb53fc tempest-AttachVolumeTestJSON-4808217 tempest-AttachVolumeTestJSON-4808217-project] 10.222.0.45 "GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88" status: 404 len: 111 microversion: 2.1 time: 0.028815 Dec 17 13:17:34.463641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1491/2980] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:34 2021] GET /compute/v2.1/servers/8b87a26d-6193-43d4-918a-92bb8c942c88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:17:58.624030 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-812728511", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "46550d4c-c394-4849-a06f-8755a419ae37"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:17:58.683290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] validate_networks() for [('46550d4c-c394-4849-a06f-8755a419ae37', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:17:59.090326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:17:59.090762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:17:59.091240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:17:59.091659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:17:59.092065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:17:59.104045 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:59.104495 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:59.105332 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:17:59.105826 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:17:59.127421 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Getting quotas for project 49cd4f65cfdc48269b1a7ee2a7db9eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:17:59.131960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Getting quotas for user 8e3840b543de43fba7cb6f496a4d1bde and project 49cd4f65cfdc48269b1a7ee2a7db9eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:17:59.143988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:17:59.148008 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:17:59.198552 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-3523702b-f3e2-4e80-8226-4ee2d5faeadd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578884 Dec 17 13:17:59.199220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1490/2981] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:17:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:17:59.208996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-9186842f-3c6e-431f-b6dd-1340d93ac758 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:17:59.209645 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-9186842f-3c6e-431f-b6dd-1340d93ac758 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:17:59.276822 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-9186842f-3c6e-431f-b6dd-1340d93ac758 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:17:59.285328 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-9186842f-3c6e-431f-b6dd-1340d93ac758 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1213 microversion: 2.1 time: 0.080003 Dec 17 13:17:59.286128 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1492/2982] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:17:59 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:00.305866 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:00.307301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:00.315439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:00.315924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:00.316784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:00.317233 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:00.402677 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:00.410825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-aff2aeb3-84be-4c7c-b9ec-676e3f960184 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1271 microversion: 2.1 time: 0.109646 Dec 17 13:18:00.411447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1491/2983] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:00 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:01.428126 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:01.429580 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:01.436367 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:01.436845 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:01.437747 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:01.438205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:01.664224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:01.672910 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-d907f1cb-b679-4e8a-81ec-7a3592a81ad4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.248597 Dec 17 13:18:01.673552 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1493/2984] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:01 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:01.713885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-3ef1280e-9b93-4387-a272-d34c26807b6d req-ffec7442-ee65-4b4e-946f-358074240836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35825ceb-7f6c-42b3-9ceb-a4590855fc8e", "tag": "177a3d07-44da-4114-8dad-9f9257d04904"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:01.716131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:01.716131 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:01.724587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3ef1280e-9b93-4387-a272-d34c26807b6d req-ffec7442-ee65-4b4e-946f-358074240836 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:01.725024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-3ef1280e-9b93-4387-a272-d34c26807b6d req-ffec7442-ee65-4b4e-946f-358074240836 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:01.736801 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-3ef1280e-9b93-4387-a272-d34c26807b6d req-ffec7442-ee65-4b4e-946f-358074240836 service nova] Creating event network-changed:177a3d07-44da-4114-8dad-9f9257d04904 for instance 35825ceb-7f6c-42b3-9ceb-a4590855fc8e on hv-cinder-80152 Dec 17 13:18:01.746464 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-3ef1280e-9b93-4387-a272-d34c26807b6d req-ffec7442-ee65-4b4e-946f-358074240836 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036455 Dec 17 13:18:01.747326 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1492/2985] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:02.691096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:02.691911 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:02.698462 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:02.698914 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:02.699735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:02.700137 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:02.839522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:02.846743 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f9a9ea18-1c69-468a-843a-e109009b8e66 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.159444 Dec 17 13:18:02.847325 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1494/2986] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:02 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:03.868496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:03.869185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:03.876462 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:03.876903 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:03.877739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:03.878159 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:04.028534 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:04.036643 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6f7279a6-ad44-4b2b-a8c4-f2e506b12099 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.172755 Dec 17 13:18:04.037241 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1493/2987] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:03 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:05.055071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:05.055618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:05.062668 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:05.063114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:05.063893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:05.064321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:05.221602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:05.229562 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e4ddea38-0cad-4523-863d-db029a5489dd tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.178410 Dec 17 13:18:05.230138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1495/2988] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:05 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:06.246942 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:06.247544 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:06.254425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:06.254873 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:06.255673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:06.256104 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:06.400182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:06.408216 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-715615ba-55bd-4c45-8d06-466ffa3714da tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.164845 Dec 17 13:18:06.408931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1494/2989] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:06 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:06.489305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-8eddf728-6e5d-4d14-ac73-d23d77d75b7f req-4519e714-b7da-4f4c-9601-6e7e16b4603b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35825ceb-7f6c-42b3-9ceb-a4590855fc8e", "name": "network-vif-plugged", "status": "completed", "tag": "177a3d07-44da-4114-8dad-9f9257d04904"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:06.491121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:06.491121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:18:06.503587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-8eddf728-6e5d-4d14-ac73-d23d77d75b7f req-4519e714-b7da-4f4c-9601-6e7e16b4603b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:06.504014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-8eddf728-6e5d-4d14-ac73-d23d77d75b7f req-4519e714-b7da-4f4c-9601-6e7e16b4603b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:06.517787 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-8eddf728-6e5d-4d14-ac73-d23d77d75b7f req-4519e714-b7da-4f4c-9601-6e7e16b4603b service nova] Creating event network-vif-plugged:177a3d07-44da-4114-8dad-9f9257d04904 for instance 35825ceb-7f6c-42b3-9ceb-a4590855fc8e on hv-cinder-80152 Dec 17 13:18:06.523251 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-8eddf728-6e5d-4d14-ac73-d23d77d75b7f req-4519e714-b7da-4f4c-9601-6e7e16b4603b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037730 Dec 17 13:18:06.524087 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1496/2990] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:07.425885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:07.426558 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:07.435546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:07.435986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:07.436933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:07.438007 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:07.594040 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:07.602569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5af83f08-067c-49b0-b2f5-3d6296f37ab4 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1313 microversion: 2.1 time: 0.181111 Dec 17 13:18:07.603173 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1495/2991] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:07 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:08.620561 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:08.621230 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:08.628387 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:08.628834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:08.629658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:08.630091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:08.769395 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:08.778476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f1cd59ad-6844-489e-9f75-b9e6796cb202 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1497 microversion: 2.1 time: 0.162285 Dec 17 13:18:08.779058 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1497/2992] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:08 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:09.200953 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:09.201541 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:09.208664 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:09.209069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:09.209952 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:09.210406 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:09.238707 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:18:09.329187 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-05185882-d4a1-4c4e-8ac4-d8b005e5247a tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "DELETE /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 204 len: 0 microversion: 2.1 time: 0.131550 Dec 17 13:18:09.329850 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1496/2993] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:18:09 2021] DELETE /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:18:09.338567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:09.339360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:09.346237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:09.346759 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:09.347714 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:09.348228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:09.506202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:09.514247 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-464a5a9e-48e6-4fc5-8508-fbd51de11432 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1503 microversion: 2.1 time: 0.179410 Dec 17 13:18:09.514800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1498/2994] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:09 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:10.532387 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:10.533076 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:10.541640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:10.542086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:10.542841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:10.543272 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:10.680819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:10.688896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9d375beb-529d-4652-afc3-fff47397ee9c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1503 microversion: 2.1 time: 0.160550 Dec 17 13:18:10.689535 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1497/2995] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:10 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:11.416201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-669fa666-16d0-4c2c-999d-916adbca7d91 req-dec661c1-cf47-4c7e-9943-6ccb183d5666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35825ceb-7f6c-42b3-9ceb-a4590855fc8e", "name": "network-vif-deleted", "tag": "177a3d07-44da-4114-8dad-9f9257d04904"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:11.417893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:11.417893 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:18:11.425996 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-669fa666-16d0-4c2c-999d-916adbca7d91 req-dec661c1-cf47-4c7e-9943-6ccb183d5666 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:11.426452 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-669fa666-16d0-4c2c-999d-916adbca7d91 req-dec661c1-cf47-4c7e-9943-6ccb183d5666 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:11.453976 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-669fa666-16d0-4c2c-999d-916adbca7d91 req-dec661c1-cf47-4c7e-9943-6ccb183d5666 service nova] Creating event network-vif-deleted:177a3d07-44da-4114-8dad-9f9257d04904 for instance 35825ceb-7f6c-42b3-9ceb-a4590855fc8e on hv-cinder-80152 Dec 17 13:18:11.460523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-669fa666-16d0-4c2c-999d-916adbca7d91 req-dec661c1-cf47-4c7e-9943-6ccb183d5666 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047696 Dec 17 13:18:11.461411 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1499/2996] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:11.706098 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:11.706637 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:11.713610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:11.714056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:11.714839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:11.715262 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:11.748694 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:11.749158 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:11.749641 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.objects.instance [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lazy-loading 'fault' on Instance uuid 35825ceb-7f6c-42b3-9ceb-a4590855fc8e {{(pid=127716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:18:11.799573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:11.809053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f08fa04f-1a52-43cc-a4b8-47d350f10ecf tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 200 len: 1303 microversion: 2.1 time: 0.106644 Dec 17 13:18:11.809595 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1498/2997] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:11 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:12.834792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:12.835459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 35825ceb-7f6c-42b3-9ceb-a4590855fc8e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:12.842486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:12.842926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:12.843708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:12.844134 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:12.859267 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] HTTP exception thrown: Instance 35825ceb-7f6c-42b3-9ceb-a4590855fc8e could not be found. Dec 17 13:18:12.859876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Returning 404 to user: Instance 35825ceb-7f6c-42b3-9ceb-a4590855fc8e could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:18:12.860721 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-322dbe58-faaf-472d-882b-a5e9d502ada0 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e" status: 404 len: 111 microversion: 2.1 time: 0.030570 Dec 17 13:18:12.861305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1500/2998] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:12 2021] GET /compute/v2.1/servers/35825ceb-7f6c-42b3-9ceb-a4590855fc8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:18:12.913930 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2011792775", "imageRef": "2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54", "flavorRef": "452", "networks": [{"uuid": "46550d4c-c394-4849-a06f-8755a419ae37"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:12.972115 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] validate_networks() for [('46550d4c-c394-4849-a06f-8755a419ae37', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:18:13.318496 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:18:13.318928 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:18:13.319466 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:18:13.319870 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:18:13.320274 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:18:13.331170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:13.331523 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:13.332321 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:13.332753 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:13.350033 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Getting quotas for project 49cd4f65cfdc48269b1a7ee2a7db9eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:18:13.354861 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Getting quotas for user 8e3840b543de43fba7cb6f496a4d1bde and project 49cd4f65cfdc48269b1a7ee2a7db9eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:18:13.367400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:18:13.369907 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2ca3b5ce-a5ca-42b0-8a3f-ee40c721db54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:18:13.415305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a7a87350-502a-414f-80fc-86439a3fea78 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505258 Dec 17 13:18:13.420661 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1499/2999] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:18:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:18:13.426463 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a89f50a7-f242-4327-beb4-74d57ad26ee6 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:13.427095 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a89f50a7-f242-4327-beb4-74d57ad26ee6 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:13.486402 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-a89f50a7-f242-4327-beb4-74d57ad26ee6 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:13.494260 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a89f50a7-f242-4327-beb4-74d57ad26ee6 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1214 microversion: 2.1 time: 0.071384 Dec 17 13:18:13.494866 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1501/3000] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:13 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:14.511122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:14.511799 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:14.519473 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:14.519914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:14.520691 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:14.521349 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:14.594185 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:14.602170 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-44c20d4e-a502-4365-b527-f0754013c0de tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1272 microversion: 2.1 time: 0.094819 Dec 17 13:18:14.608754 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1500/3001] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:14 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:15.619609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:15.620234 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:15.628419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:15.628776 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:15.629596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:15.630016 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:15.658530 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-ddbf682d-4b6f-46f3-b030-eeffef4c457b req-5e25f008-32b3-49fa-82f9-77027ab2e594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4382b887-2681-4d56-aa63-82ee46c09f50", "tag": "406cbab8-4bf0-4079-bc74-4ceb7dafde65"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:15.661228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:15.661228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:15.670339 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ddbf682d-4b6f-46f3-b030-eeffef4c457b req-5e25f008-32b3-49fa-82f9-77027ab2e594 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:15.670781 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-ddbf682d-4b6f-46f3-b030-eeffef4c457b req-5e25f008-32b3-49fa-82f9-77027ab2e594 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:15.683644 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-ddbf682d-4b6f-46f3-b030-eeffef4c457b req-5e25f008-32b3-49fa-82f9-77027ab2e594 service nova] Creating event network-changed:406cbab8-4bf0-4079-bc74-4ceb7dafde65 for instance 4382b887-2681-4d56-aa63-82ee46c09f50 on hv-cinder-80152 Dec 17 13:18:15.688702 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-ddbf682d-4b6f-46f3-b030-eeffef4c457b req-5e25f008-32b3-49fa-82f9-77027ab2e594 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035386 Dec 17 13:18:15.689301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1501/3002] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:15.864894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:15.874127 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-12f2d9db-9c52-4d72-9b7e-abd50c259c9f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.258163 Dec 17 13:18:15.874730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1502/3003] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:15 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:16.893763 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:16.894592 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:16.901228 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:16.901834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:16.902764 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:16.903203 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:17.039338 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:17.047978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-da458255-ad00-4da2-bc06-4a04e5dc9ca8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.159111 Dec 17 13:18:17.048635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1502/3004] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:16 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:18.065434 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:18.066034 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:18.072833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:18.073301 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:18.074086 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:18.074521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:18.212694 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:18.220239 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1159ca87-fdca-4cfc-9ca0-5ca23aab3833 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.158601 Dec 17 13:18:18.220777 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1503/3005] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:18 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:19.237531 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:19.238156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:19.244986 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:19.245470 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:19.246220 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:19.246667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:19.383886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:19.391862 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4008fad9-8170-4613-ac6b-9065cf6343b5 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.158000 Dec 17 13:18:19.392427 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1503/3006] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:19 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:20.408006 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:20.409097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:20.416294 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:20.416869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:20.417754 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:20.418188 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:20.557491 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-e4dc66b5-98b7-4985-87d8-03a23ee91c46 req-a8397037-63ed-49e1-a5e4-ea493c18e70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382b887-2681-4d56-aa63-82ee46c09f50", "name": "network-vif-plugged", "status": "completed", "tag": "406cbab8-4bf0-4079-bc74-4ceb7dafde65"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:20.560818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:20.560818 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:20.562213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:20.569616 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e4dc66b5-98b7-4985-87d8-03a23ee91c46 req-a8397037-63ed-49e1-a5e4-ea493c18e70c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:20.569815 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-e4dc66b5-98b7-4985-87d8-03a23ee91c46 req-a8397037-63ed-49e1-a5e4-ea493c18e70c service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:20.572282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0983188c-f99e-48b2-81ab-09481d99c344 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.167922 Dec 17 13:18:20.573067 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1504/3007] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:20 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:20.582042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-e4dc66b5-98b7-4985-87d8-03a23ee91c46 req-a8397037-63ed-49e1-a5e4-ea493c18e70c service nova] Creating event network-vif-plugged:406cbab8-4bf0-4079-bc74-4ceb7dafde65 for instance 4382b887-2681-4d56-aa63-82ee46c09f50 on hv-cinder-80152 Dec 17 13:18:20.587587 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-e4dc66b5-98b7-4985-87d8-03a23ee91c46 req-a8397037-63ed-49e1-a5e4-ea493c18e70c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Dec 17 13:18:20.588300 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1504/3008] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:21.589506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:21.590154 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:21.597055 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:21.597513 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:21.598314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:21.598746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:21.757394 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:21.765254 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-08eb68af-daa6-4abc-841c-c7ba6ea12618 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1314 microversion: 2.1 time: 0.179469 Dec 17 13:18:21.765855 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1505/3009] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:21 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:22.783684 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:22.784666 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:22.792091 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:22.792563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:22.793461 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:22.793897 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:22.960590 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:22.968623 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6d0caa93-9ecc-40e4-9f64-151977f0d09b tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1498 microversion: 2.1 time: 0.189478 Dec 17 13:18:22.969204 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1505/3010] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:22 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:23.405553 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:23.406125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:23.412575 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:23.413114 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:23.414735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:23.414735 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:23.441783 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:18:23.528579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-12e7f344-35dd-4a1e-945f-5e5cba0a349c tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 204 len: 0 microversion: 2.1 time: 0.125672 Dec 17 13:18:23.528579 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1506/3011] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:18:23 2021] DELETE /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:18:23.537485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:23.538266 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:23.546346 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:23.547111 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:23.548463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:23.553389 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:23.693556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:23.701519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1f718f1e-e7f5-4699-b281-d588108b62b8 tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1504 microversion: 2.1 time: 0.167882 Dec 17 13:18:23.702122 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1506/3012] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:23 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:24.720201 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:24.720924 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:24.727851 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:24.728347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:24.729054 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:24.729506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:24.871574 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:24.879332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f7e682e4-9a79-4669-8ddf-bba90b79288f tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1504 microversion: 2.1 time: 0.163233 Dec 17 13:18:24.879936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1507/3013] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:24 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:25.657771 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-45d9baa6-eabc-4c37-b132-eb338e4e0617 req-0a1cde83-8000-4a35-81bc-795f9807b581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382b887-2681-4d56-aa63-82ee46c09f50", "name": "network-vif-deleted", "tag": "406cbab8-4bf0-4079-bc74-4ceb7dafde65"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:25.659303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:25.659303 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:25.668565 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-45d9baa6-eabc-4c37-b132-eb338e4e0617 req-0a1cde83-8000-4a35-81bc-795f9807b581 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:25.669817 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-45d9baa6-eabc-4c37-b132-eb338e4e0617 req-0a1cde83-8000-4a35-81bc-795f9807b581 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:25.683232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-45d9baa6-eabc-4c37-b132-eb338e4e0617 req-0a1cde83-8000-4a35-81bc-795f9807b581 service nova] Creating event network-vif-deleted:406cbab8-4bf0-4079-bc74-4ceb7dafde65 for instance 4382b887-2681-4d56-aa63-82ee46c09f50 on hv-cinder-80152 Dec 17 13:18:25.689293 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-45d9baa6-eabc-4c37-b132-eb338e4e0617 req-0a1cde83-8000-4a35-81bc-795f9807b581 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035568 Dec 17 13:18:25.689937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1507/3014] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:25.898823 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:25.899415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:25.905960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:25.906396 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:25.907171 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:25.907591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:25.940730 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:25.941163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:25.941641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.objects.instance [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lazy-loading 'fault' on Instance uuid 4382b887-2681-4d56-aa63-82ee46c09f50 {{(pid=127717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 17 13:18:25.985457 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3840b543de43fba7cb6f496a4d1bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49cd4f65cfdc48269b1a7ee2a7db9eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:25.993170 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-43aa43ba-226d-41b6-a70f-cd7f012a20bc tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 200 len: 1304 microversion: 2.1 time: 0.098135 Dec 17 13:18:25.993784 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1508/3015] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:25 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:27.011047 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:27.011860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] [instance: 4382b887-2681-4d56-aa63-82ee46c09f50] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:27.019078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:27.019511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:27.020290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:27.020718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:27.035317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] HTTP exception thrown: Instance 4382b887-2681-4d56-aa63-82ee46c09f50 could not be found. Dec 17 13:18:27.035812 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] Returning 404 to user: Instance 4382b887-2681-4d56-aa63-82ee46c09f50 could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:18:27.036673 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-22875701-4990-4e57-af88-0da31ceabceb tempest-VolumesActionsTest-724331882 tempest-VolumesActionsTest-724331882-project] 10.222.0.45 "GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50" status: 404 len: 111 microversion: 2.1 time: 0.030326 Dec 17 13:18:27.037232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1508/3016] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:27 2021] GET /compute/v2.1/servers/4382b887-2681-4d56-aa63-82ee46c09f50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:18:30.670476 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:18:30.671177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:18:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:18:42.158081 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-4822c679-43ca-4382-b103-a073d55cac0b req-b5560f8b-6c38-4a6b-bdef-53907e817167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:42.160523 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:42.161032 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:42.167137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:42.167137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:42.176141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4822c679-43ca-4382-b103-a073d55cac0b req-b5560f8b-6c38-4a6b-bdef-53907e817167 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:42.176392 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:42.176911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-4822c679-43ca-4382-b103-a073d55cac0b req-b5560f8b-6c38-4a6b-bdef-53907e817167 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:42.179991 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:42.183831 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:42.186726 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:42.193796 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-4822c679-43ca-4382-b103-a073d55cac0b req-b5560f8b-6c38-4a6b-bdef-53907e817167 service nova] Creating event network-changed:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:18:42.205573 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-4822c679-43ca-4382-b103-a073d55cac0b req-b5560f8b-6c38-4a6b-bdef-53907e817167 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050853 Dec 17 13:18:42.206417 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1509/3017] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:42.216667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:18:42.354936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-4b31b1a3-933e-4b08-9dea-14a981760cbb tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "DELETE /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 204 len: 0 microversion: 2.1 time: 0.200022 Dec 17 13:18:42.356508 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1509/3018] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:18:42 2021] DELETE /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:18:42.369569 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:42.370871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:42.382570 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:42.383719 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:42.385880 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:42.386969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:42.775682 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:42.787250 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-40508108-a548-4f7e-b922-c8dff56f093b tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1568 microversion: 2.1 time: 0.425554 Dec 17 13:18:42.798601 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1510/3019] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:42 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:43.808577 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:43.810204 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:43.817358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:43.818331 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:43.819625 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:43.820293 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:44.050760 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:44.060591 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-252cf8fd-6277-4c4d-b01f-6a0a8d86e294 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1449 microversion: 2.1 time: 0.258503 Dec 17 13:18:44.070695 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1510/3020] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:43 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1449 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:44.953610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-02c5ce1c-8042-403a-b31a-c0d3dcb7e712 req-977f23b9-ee4a-4407-99c5-e826d8d50a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ba4cff-5951-40ca-bd3f-cd6c1667708e", "name": "network-vif-deleted", "tag": "8f252a40-c2b5-4428-a2c6-9775e7612cab"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:18:44.955794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:18:44.955794 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:18:44.968477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-02c5ce1c-8042-403a-b31a-c0d3dcb7e712 req-977f23b9-ee4a-4407-99c5-e826d8d50a66 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:44.969950 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-02c5ce1c-8042-403a-b31a-c0d3dcb7e712 req-977f23b9-ee4a-4407-99c5-e826d8d50a66 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:44.984992 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-02c5ce1c-8042-403a-b31a-c0d3dcb7e712 req-977f23b9-ee4a-4407-99c5-e826d8d50a66 service nova] Creating event network-vif-deleted:8f252a40-c2b5-4428-a2c6-9775e7612cab for instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e on hv-cinder-80152 Dec 17 13:18:44.991836 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-02c5ce1c-8042-403a-b31a-c0d3dcb7e712 req-977f23b9-ee4a-4407-99c5-e826d8d50a66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119340 Dec 17 13:18:44.993089 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1511/3021] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:18:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:18:45.081901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:45.083272 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:45.091030 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:45.091470 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:45.092249 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:45.092670 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:45.179063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd0455cb0ac44e592f820a8499ec077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f552590cfc426787d4bd1d01c981c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:18:45.188120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-37ff2213-b024-496e-9a1c-00ad8b8a53c5 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 200 len: 1220 microversion: 2.1 time: 0.112471 Dec 17 13:18:45.189048 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1511/3022] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:45 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:18:46.208254 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:46.209647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] [instance: 44ba4cff-5951-40ca-bd3f-cd6c1667708e] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:18:46.219106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:46.219580 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:46.220396 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:18:46.220834 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:18:46.235655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] HTTP exception thrown: Instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e could not be found. Dec 17 13:18:46.236275 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Returning 404 to user: Instance 44ba4cff-5951-40ca-bd3f-cd6c1667708e could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:18:46.237137 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-ee1ad4f0-bff3-4f76-ab28-8a50d48e3484 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e" status: 404 len: 111 microversion: 2.1 time: 0.034933 Dec 17 13:18:46.237739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1512/3023] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:18:46 2021] GET /compute/v2.1/servers/44ba4cff-5951-40ca-bd3f-cd6c1667708e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 17 13:18:46.463205 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-790ba50a-10f0-4b96-9df6-73ef53a621c6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] Calling method '.version_select at 0x7fba112f9310>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:18:46.498211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-790ba50a-10f0-4b96-9df6-73ef53a621c6 tempest-TestShelveInstance-164368903 tempest-TestShelveInstance-164368903-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1204495767" status: 202 len: 0 microversion: 2.1 time: 0.038990 Dec 17 13:18:46.499053 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1512/3024] 10.222.0.45 () {58 vars in 1253 bytes} [Fri Dec 17 13:18:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1204495767 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:19:06.054701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Action: 'create', calling method: .version_select at 0x7fba11f859d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1250858390"}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:19:06.070914 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:19:06.075747 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for user 4cb0f6186c4145ed858e7e44b0ceda3f and project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:19:06.336169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:19:06.341989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for user 4cb0f6186c4145ed858e7e44b0ceda3f and project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'key_pairs'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:19:06.358200 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-a516d9e5-a087-4397-8e92-a8fd8e953359 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.491380 Dec 17 13:19:06.359221 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1513/3025] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Dec 17 13:19:05 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:32.130263 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-56718499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1250858390", "security_groups": [{"name": "tempest-secgroup-smoke-2009789196"}], "block_device_mapping_v2": [{"uuid": "d6367e05-f45a-45e9-b693-c53c9342423b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5cb035f3-d7f9-4969-b057-a5fa49f01ed0"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:19:32.418544 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] validate_networks() for [('5cb035f3-d7f9-4969-b057-a5fa49f01ed0', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:19:32.922361 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:19:32.922920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:19:32.923384 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:19:32.923781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:19:32.924211 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:19:32.933842 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:32.934296 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:32.935153 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:32.935584 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:32.952687 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:19:32.957213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for user 4cb0f6186c4145ed858e7e44b0ceda3f and project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:19:33.024984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:19:33.027177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6367e05-f45a-45e9-b693-c53c9342423b',volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:19:33.168358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-a6278e39-d8b9-4c35-9409-37b727d1edc2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.042605 Dec 17 13:19:33.169164 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1513/3026] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:19:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:19:33.181068 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-498f71a6-eb65-4cca-b94d-d4c85e075a0b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:33.181667 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-498f71a6-eb65-4cca-b94d-d4c85e075a0b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:33.237984 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-498f71a6-eb65-4cca-b94d-d4c85e075a0b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:33.244746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-498f71a6-eb65-4cca-b94d-d4c85e075a0b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1093 microversion: 2.1 time: 0.068265 Dec 17 13:19:33.245378 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1514/3027] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:33 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:34.261920 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:34.263500 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:34.270953 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:34.271488 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:34.272311 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:34.272707 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:34.360013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:34.368346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e229e0d9-6656-4d66-9631-337773648e30 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1209 microversion: 2.1 time: 0.110746 Dec 17 13:19:34.377826 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1514/3028] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:34 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:35.385391 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:35.386000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:35.392720 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:35.393156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:35.393975 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:35.394400 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:35.561807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:35.570212 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c946a40f-3f1b-4445-a69a-c23599b770cd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.188407 Dec 17 13:19:35.571529 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1515/3029] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:35 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:35.642227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-37fbfbb2-a87a-4375-b0f9-57c4001d05f1 req-7e7577bb-921e-4597-8867-bc5087e38c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c869dc7-c330-4757-9e2f-c2ccbeb58b2f", "tag": "615d36f1-9277-4d1c-8794-79b5d87df23f"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:19:35.644664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:19:35.644664 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:19:35.652750 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-37fbfbb2-a87a-4375-b0f9-57c4001d05f1 req-7e7577bb-921e-4597-8867-bc5087e38c46 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:35.653489 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-37fbfbb2-a87a-4375-b0f9-57c4001d05f1 req-7e7577bb-921e-4597-8867-bc5087e38c46 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:35.665969 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-37fbfbb2-a87a-4375-b0f9-57c4001d05f1 req-7e7577bb-921e-4597-8867-bc5087e38c46 service nova] Creating event network-changed:615d36f1-9277-4d1c-8794-79b5d87df23f for instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f on hv-cinder-80152 Dec 17 13:19:35.680372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-37fbfbb2-a87a-4375-b0f9-57c4001d05f1 req-7e7577bb-921e-4597-8867-bc5087e38c46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Dec 17 13:19:35.681958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1515/3030] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:19:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:19:36.588042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:36.588627 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:36.598126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:36.598579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:36.599347 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:36.599784 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:36.742660 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:36.750540 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f58bb324-8536-435d-9f96-a8f082e7cd5b tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.166265 Dec 17 13:19:36.751172 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1516/3031] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:36 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:37.768596 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:37.769253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:37.776029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:37.776473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:37.777253 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:37.777696 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:37.916415 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:37.925340 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-f23a9848-61f0-4541-8bf0-01ede145eaee tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.161333 Dec 17 13:19:37.925959 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1516/3032] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:37 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:38.942398 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:38.943000 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:38.950282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:38.950721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:38.951533 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:38.951960 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:39.098657 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:39.106550 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b2166f66-2299-44a9-b0c4-2d9088856ecc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.167925 Dec 17 13:19:39.107128 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1517/3033] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:38 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:40.123155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:40.123718 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:40.130639 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:40.131084 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:40.131863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:40.132289 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:40.282379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:40.290794 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0a320b11-8187-48ce-b215-843ef8084a6f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.171355 Dec 17 13:19:40.291355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1517/3034] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:40 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:41.307739 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:41.308316 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:41.315379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:41.315822 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:41.316645 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:41.317078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:41.455060 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:41.462904 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-83f4b939-23e5-463f-bfd2-28dc9da88d97 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.158822 Dec 17 13:19:41.463490 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1518/3035] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:41 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:42.479936 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:42.480509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:42.487414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:42.487858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:42.488632 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:42.489029 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:42.631298 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:42.638719 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-85d3c2a0-8def-4fa2-a6db-efca3e3f30b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.162928 Dec 17 13:19:42.639290 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1518/3036] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:42 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:43.655394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:43.655972 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:43.662956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:43.663405 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:43.664184 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:43.664615 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:43.810563 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:43.822304 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-4ceae863-2a8e-491a-9352-e603a22b17e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.170290 Dec 17 13:19:43.823255 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1519/3037] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:43 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:44.842019 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:44.842622 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:44.850339 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:44.850792 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:44.851655 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:44.852119 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:44.988215 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:44.997603 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-31c9cddd-dfdb-4a09-b54b-1680d14396fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.159171 Dec 17 13:19:44.998542 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1519/3038] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:44 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:46.015585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:46.016498 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:46.023150 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:46.023596 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:46.024442 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:46.025019 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:46.162430 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:46.172493 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-b46fc27c-97c0-4fef-9511-27031da88931 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.161129 Dec 17 13:19:46.173165 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1520/3039] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:46 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:47.129123 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-e0b176c9-61d1-4745-940b-ec851ce34aaf req-0dce45b6-7622-4f1b-90b2-6c3839d89f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c869dc7-c330-4757-9e2f-c2ccbeb58b2f", "name": "network-vif-plugged", "status": "completed", "tag": "615d36f1-9277-4d1c-8794-79b5d87df23f"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:19:47.130778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:19:47.130778 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:19:47.138438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e0b176c9-61d1-4745-940b-ec851ce34aaf req-0dce45b6-7622-4f1b-90b2-6c3839d89f2d service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:47.138878 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-e0b176c9-61d1-4745-940b-ec851ce34aaf req-0dce45b6-7622-4f1b-90b2-6c3839d89f2d service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:47.150650 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-e0b176c9-61d1-4745-940b-ec851ce34aaf req-0dce45b6-7622-4f1b-90b2-6c3839d89f2d service nova] Creating event network-vif-plugged:615d36f1-9277-4d1c-8794-79b5d87df23f for instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f on hv-cinder-80152 Dec 17 13:19:47.156250 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-e0b176c9-61d1-4745-940b-ec851ce34aaf req-0dce45b6-7622-4f1b-90b2-6c3839d89f2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098586 Dec 17 13:19:47.156897 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1520/3040] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:19:47.189780 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:47.190489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:47.197083 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:47.197762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:47.198548 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:47.198982 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:47.352012 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:47.361877 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77d0208d-fcb0-4932-b330-d7da6811b184 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.175752 Dec 17 13:19:47.362482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1521/3041] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:47 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:48.383737 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:48.384885 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:48.391838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:48.392277 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:48.393064 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:48.393539 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:48.534697 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:48.542419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-5f758a8f-0553-4e9d-af05-19d0d89641e2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1265 microversion: 2.1 time: 0.166679 Dec 17 13:19:48.543010 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1521/3042] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:48 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:49.559776 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:49.560382 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:49.567065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:49.567485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:49.568290 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:49.568721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:49.711501 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:49.719438 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c43d50ef-357d-4b91-9bbb-9d01e2cafb29 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1452 microversion: 2.1 time: 0.163401 Dec 17 13:19:49.720078 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1522/3043] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:49 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:49.735641 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:19:49.736224 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:19:49.742727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:49.743213 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:49.744021 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:49.744423 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:49.883903 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:19:49.892103 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-e4918073-1763-4c3e-abdd-25841ec20db0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1452 microversion: 2.1 time: 0.160160 Dec 17 13:19:49.892691 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1522/3044] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:19:49 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:19:51.708926 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-0f87d417-b6ef-4f0a-8232-e814f8254907 req-7c82fb93-67e8-4252-92cc-bac5040637eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c869dc7-c330-4757-9e2f-c2ccbeb58b2f", "tag": "615d36f1-9277-4d1c-8794-79b5d87df23f"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:19:51.710481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:19:51.710481 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:19:51.717922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0f87d417-b6ef-4f0a-8232-e814f8254907 req-7c82fb93-67e8-4252-92cc-bac5040637eb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:19:51.718360 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-0f87d417-b6ef-4f0a-8232-e814f8254907 req-7c82fb93-67e8-4252-92cc-bac5040637eb service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:19:51.730575 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-0f87d417-b6ef-4f0a-8232-e814f8254907 req-7c82fb93-67e8-4252-92cc-bac5040637eb service nova] Creating event network-changed:615d36f1-9277-4d1c-8794-79b5d87df23f for instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f on hv-cinder-80152 Dec 17 13:19:51.736018 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-0f87d417-b6ef-4f0a-8232-e814f8254907 req-7c82fb93-67e8-4252-92cc-bac5040637eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088501 Dec 17 13:19:51.736539 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1523/3045] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:19:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:21:44.329669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:21:44.330439 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:21:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:21:49.467961 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:21:49.468958 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:21:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:21:50.689309 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:21:50.689931 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:21:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:22:05.593810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 17 13:22:05.597355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:05.597849 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:05.604421 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:05.604860 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:05.605677 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:05.606101 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:05.632276 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Going to try to terminate instance {{(pid=127717) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:22:05.717939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-0ae1d390-16c2-4c88-b726-fe1848699e65 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 204 len: 0 microversion: 2.1 time: 0.125480 Dec 17 13:22:05.718880 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1523/3046] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:22:05 2021] DELETE /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:22:05.725762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5febd58d-ad76-4cf9-a5df-876efa8b0365] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 17 13:22:05.729687 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:05.730379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:05.737795 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:05.738240 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:05.739024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:05.740583 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:05.883589 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:05.895271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f44c08a7-50b6-4538-8618-f03943ad903a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1576 microversion: 2.1 time: 0.171223 Dec 17 13:22:05.895827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1524/3047] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:05 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:06.913769 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:06.914509 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:06.932988 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:06.933467 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:06.934227 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:06.934658 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:06.940186 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45276. Dec 17 13:22:07.077724 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:07.085764 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cad82ba6-9b87-41e4-9214-c4a6622c1c24 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1576 microversion: 2.1 time: 0.176288 Dec 17 13:22:07.086338 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1524/3048] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:06 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:08.103659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:08.104236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:08.122182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:08.122598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:08.123412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:08.123833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:08.129579 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] [5febd58d-ad76-4cf9-a5df-876efa8b0365] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45280. Dec 17 13:22:08.286708 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:08.297988 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9de046ea-91f3-4f85-9b1d-4cfbaef458ce tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 200 len: 1576 microversion: 2.1 time: 0.198038 Dec 17 13:22:08.299282 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1525/3049] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:08 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:08.551203 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-cc738cc7-2c50-4f5a-8312-3306f41ee3a9 req-3776c93d-ce76-4f1b-9e93-49c7d842021b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c869dc7-c330-4757-9e2f-c2ccbeb58b2f", "name": "network-vif-deleted", "tag": "615d36f1-9277-4d1c-8794-79b5d87df23f"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:22:08.552989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:22:08.552989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:22:08.562894 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-cc738cc7-2c50-4f5a-8312-3306f41ee3a9 req-3776c93d-ce76-4f1b-9e93-49c7d842021b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:08.563549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-cc738cc7-2c50-4f5a-8312-3306f41ee3a9 req-3776c93d-ce76-4f1b-9e93-49c7d842021b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:08.579375 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-cc738cc7-2c50-4f5a-8312-3306f41ee3a9 req-3776c93d-ce76-4f1b-9e93-49c7d842021b service nova] Creating event network-vif-deleted:615d36f1-9277-4d1c-8794-79b5d87df23f for instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f on hv-cinder-80152 Dec 17 13:22:08.587781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-cc738cc7-2c50-4f5a-8312-3306f41ee3a9 req-3776c93d-ce76-4f1b-9e93-49c7d842021b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Dec 17 13:22:08.588843 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1525/3050] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:22:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:22:09.315924 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:09.317117 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:09.323997 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:09.324423 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:09.325413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:09.325721 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:09.341107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] HTTP exception thrown: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. Dec 17 13:22:09.342065 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Returning 404 to user: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:22:09.343139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-48da564a-7d0b-4b75-b45b-a53de4291281 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 404 len: 111 microversion: 2.1 time: 0.031039 Dec 17 13:22:09.343733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1526/3051] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:09 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:22:09.401063 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-960734872", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1250858390", "security_groups": [{"name": "tempest-secgroup-smoke-2009789196"}], "block_device_mapping_v2": [{"uuid": "d6367e05-f45a-45e9-b693-c53c9342423b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5cb035f3-d7f9-4969-b057-a5fa49f01ed0"}]}} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:22:09.525586 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.network.neutron [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] validate_networks() for [('5cb035f3-d7f9-4969-b057-a5fa49f01ed0', None, None, None, None, None)] {{(pid=127717) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:22:09.909477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:22:09.910074 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image limits 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:22:09.910358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:22:09.910761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image pref 0:0:0 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:22:09.911172 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.virt.hardware [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:22:09.922712 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:09.923182 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:09.924136 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:09.924571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:09.943216 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:22:09.947798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.quota [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for user 4cb0f6186c4145ed858e7e44b0ceda3f and project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127717) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:22:10.009678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Going to run 1 instances... {{(pid=127717) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:22:10.012024 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6367e05-f45a-45e9-b693-c53c9342423b',volume_size=None,volume_type=None)] {{(pid=127717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:22:10.140952 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2742cbcc-91e8-4d66-a07c-1c25a26143bf tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744000 Dec 17 13:22:10.141701 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1526/3052] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:22:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:22:10.152585 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-5b39d9f8-1d8b-4158-99e8-f14a67d9f4db tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:10.153207 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-5b39d9f8-1d8b-4158-99e8-f14a67d9f4db tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:10.226101 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-5b39d9f8-1d8b-4158-99e8-f14a67d9f4db tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:10.236602 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-5b39d9f8-1d8b-4158-99e8-f14a67d9f4db tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1094 microversion: 2.1 time: 0.087986 Dec 17 13:22:10.237956 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1527/3053] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:10 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:11.254094 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:11.255352 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:11.265257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:11.265834 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:11.266740 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:11.267233 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:11.339942 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:11.349746 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-ba110c4e-5821-451d-8f02-eed1198482b8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1210 microversion: 2.1 time: 0.099840 Dec 17 13:22:11.350403 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1527/3054] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:11 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:12.367413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:12.368011 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:12.375837 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:12.376636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:12.377655 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:12.378092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:12.535123 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:12.540013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-5290b97f-2fc5-45ca-b3d1-59b8db7a12ca req-90ad2f2a-96a1-44e8-b9c6-4205b9be4c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac3a216-462a-4b1e-8ba4-39679fb5f2c2", "tag": "2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:22:12.542315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:22:12.542315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:22:12.557648 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c3d6bfc1-559c-48b8-8ffe-f1fe79346f5f tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.193919 Dec 17 13:22:12.558099 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1528/3055] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:12 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:12.560833 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-5290b97f-2fc5-45ca-b3d1-59b8db7a12ca req-90ad2f2a-96a1-44e8-b9c6-4205b9be4c92 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:12.561355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-5290b97f-2fc5-45ca-b3d1-59b8db7a12ca req-90ad2f2a-96a1-44e8-b9c6-4205b9be4c92 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:12.573748 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-5290b97f-2fc5-45ca-b3d1-59b8db7a12ca req-90ad2f2a-96a1-44e8-b9c6-4205b9be4c92 service nova] Creating event network-changed:2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c for instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 on hv-cinder-80152 Dec 17 13:22:12.579556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-5290b97f-2fc5-45ca-b3d1-59b8db7a12ca req-90ad2f2a-96a1-44e8-b9c6-4205b9be4c92 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043942 Dec 17 13:22:12.580246 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1528/3056] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:22:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:22:13.574965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:13.575561 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:13.582886 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:13.583252 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:13.584027 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:13.584458 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:13.727807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:13.735805 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-62e704ac-4399-4005-879f-6f87d6fb45fa tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.164602 Dec 17 13:22:13.736568 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1529/3057] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:13 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:14.754805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:14.755490 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:14.762315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:14.762751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:14.763527 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:14.763960 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:14.914166 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:14.923689 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6f034616-99e7-4a1f-8efb-a7068a25d1f8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.174506 Dec 17 13:22:14.924397 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1529/3058] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:14 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:15.941306 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:15.941894 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:15.948722 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:15.949169 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:15.949969 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:15.950452 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:16.104860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:16.114933 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-7a889ae0-dc7c-4e95-8ec1-7ba73fe34772 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.177355 Dec 17 13:22:16.115693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1530/3059] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:15 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:17.132541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:17.133104 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:17.139927 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:17.140479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:17.141269 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:17.141755 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:17.282497 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:17.290653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-00ac2513-4bd5-4f6b-b9fe-ac2c2561c1ff tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.162262 Dec 17 13:22:17.291270 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1530/3060] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:17 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:18.307896 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:18.308485 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:18.315492 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:18.315937 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:18.316710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:18.317143 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:18.459425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:18.470562 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-c660890e-acca-428e-84ca-45b2a2d519f4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.165949 Dec 17 13:22:18.471633 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1531/3061] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:18 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:19.488804 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:19.489479 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:19.496334 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:19.496775 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:19.497618 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:19.498052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:19.636901 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:19.644716 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-b7bfc106-1e8d-49b5-bfcf-4a0443c10ca7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.159913 Dec 17 13:22:19.645333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1531/3062] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:19 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:20.661807 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:20.662447 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:20.668965 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:20.669441 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:20.670218 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:20.670647 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:20.811831 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:20.819341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-d9df62ed-e604-4df6-984e-37d4edb761ab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.161398 Dec 17 13:22:20.819921 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1532/3063] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:20 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:21.837184 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:21.838237 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:21.845414 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:21.845862 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:21.846653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:21.847077 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:21.848489 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [req-fed526a4-e4d9-497c-bbea-77de58c61007 req-5beed3c6-a36e-40cf-aa96-4c61a6cfa647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac3a216-462a-4b1e-8ba4-39679fb5f2c2", "name": "network-vif-plugged", "status": "completed", "tag": "2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c"}]} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:22:21.850103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:22:21.850103 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: warnings.warn(msg) Dec 17 13:22:21.858399 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fed526a4-e4d9-497c-bbea-77de58c61007 req-5beed3c6-a36e-40cf-aa96-4c61a6cfa647 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:21.858840 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [req-fed526a4-e4d9-497c-bbea-77de58c61007 req-5beed3c6-a36e-40cf-aa96-4c61a6cfa647 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:21.871710 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.compute.server_external_events [req-fed526a4-e4d9-497c-bbea-77de58c61007 req-5beed3c6-a36e-40cf-aa96-4c61a6cfa647 service nova] Creating event network-vif-plugged:2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c for instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 on hv-cinder-80152 Dec 17 13:22:21.876888 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [req-fed526a4-e4d9-497c-bbea-77de58c61007 req-5beed3c6-a36e-40cf-aa96-4c61a6cfa647 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Dec 17 13:22:21.877927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1533/3064] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 17 13:22:21.993989 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:22.001459 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-80a2227b-6105-40e3-9f02-fd008b31a866 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.168986 Dec 17 13:22:22.002050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1532/3065] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:21 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:23.019593 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:23.020787 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:23.028860 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:23.029319 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:23.030112 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:23.030546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:23.182317 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:23.190301 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-cdef7261-b837-4a83-b9d8-5e725b28c6fd tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1266 microversion: 2.1 time: 0.175464 Dec 17 13:22:23.190878 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1534/3066] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:23 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:24.208346 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:24.208932 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:24.215781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:24.216228 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:24.217005 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:24.217477 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:24.360059 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:24.368178 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c781bd52-0e39-4331-aad9-17d402558bab tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1452 microversion: 2.1 time: 0.164060 Dec 17 13:22:24.369051 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1533/3067] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:24 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:24.385156 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:22:24.385808 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:22:24.392671 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:24.393119 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:24.394110 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:24.394546 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:24.544872 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:22:24.552610 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-53d8d897-6aa4-44f3-8350-2332b43fefb0 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1452 microversion: 2.1 time: 0.171107 Dec 17 13:22:24.553223 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1535/3068] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:22:24 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:22:26.528222 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-ac6673e0-a594-434f-9cd4-80588a5006cc req-ba2d00db-5a72-401a-a284-b3f8e4311ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac3a216-462a-4b1e-8ba4-39679fb5f2c2", "tag": "2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:22:26.529797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:22:26.529797 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:22:26.542455 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-ac6673e0-a594-434f-9cd4-80588a5006cc req-ba2d00db-5a72-401a-a284-b3f8e4311ad6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:22:26.542926 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-ac6673e0-a594-434f-9cd4-80588a5006cc req-ba2d00db-5a72-401a-a284-b3f8e4311ad6 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:22:26.554417 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-ac6673e0-a594-434f-9cd4-80588a5006cc req-ba2d00db-5a72-401a-a284-b3f8e4311ad6 service nova] Creating event network-changed:2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c for instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 on hv-cinder-80152 Dec 17 13:22:26.560145 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-ac6673e0-a594-434f-9cd4-80588a5006cc req-ba2d00db-5a72-401a-a284-b3f8e4311ad6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035769 Dec 17 13:22:26.561231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1534/3069] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:22:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:23:25.993519 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:23:25.994177 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:23:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:24:26.697236 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1012719059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1250858390", "security_groups": [{"name": "tempest-secgroup-smoke-2009789196"}], "block_device_mapping_v2": [{"uuid": "bdff07b7-e60f-40be-bd9d-541188d465e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5cb035f3-d7f9-4969-b057-a5fa49f01ed0"}]}} {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:24:26.900911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.network.neutron [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] validate_networks() for [('5cb035f3-d7f9-4969-b057-a5fa49f01ed0', None, None, None, None, None)] {{(pid=127716) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 17 13:24:27.345746 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 17 13:24:27.346163 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image limits 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 17 13:24:27.346625 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Flavor pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 17 13:24:27.347024 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Image pref 0:0:0 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 17 13:24:27.347425 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.virt.hardware [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 17 13:24:27.357235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:27.357706 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:27.358762 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:27.359196 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:27.376678 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 17 13:24:27.381126 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.quota [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Getting quotas for user 4cb0f6186c4145ed858e7e44b0ceda3f and project f3ea7b474f1b4c24b7afd417f1f08df2. Resources: {'cores', 'instances', 'ram'} {{(pid=127716) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 17 13:24:27.441966 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Going to run 1 instances... {{(pid=127716) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 17 13:24:27.444164 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdff07b7-e60f-40be-bd9d-541188d465e4',volume_size=None,volume_type=None)] {{(pid=127716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 17 13:24:27.580964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-2c08407e-c96d-46cc-ab85-307cbd0b828d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888334 Dec 17 13:24:27.581686 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1536/3070] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Dec 17 13:24:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 17 13:24:27.590305 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 17 13:24:27.594284 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-47573a9f-1504-4e71-a020-bf48feab48dc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:27.594917 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-47573a9f-1504-4e71-a020-bf48feab48dc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:27.707124 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-47573a9f-1504-4e71-a020-bf48feab48dc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:27.714332 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-47573a9f-1504-4e71-a020-bf48feab48dc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1095 microversion: 2.1 time: 0.126239 Dec 17 13:24:27.714898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1535/3071] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:27 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1095 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:28.731394 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-400bd47b-ad8f-4417-8bbe-01a96c4ab9e4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:28.731964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-400bd47b-ad8f-4417-8bbe-01a96c4ab9e4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:28.784700 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-400bd47b-ad8f-4417-8bbe-01a96c4ab9e4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:28.792582 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-400bd47b-ad8f-4417-8bbe-01a96c4ab9e4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1095 microversion: 2.1 time: 0.065084 Dec 17 13:24:28.793129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1537/3072] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:28 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:29.808708 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-c84fc9dd-8243-4da9-812b-6eeb8cd6e3d4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:29.809347 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-c84fc9dd-8243-4da9-812b-6eeb8cd6e3d4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:29.846121 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45462. Dec 17 13:24:29.874257 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-c84fc9dd-8243-4da9-812b-6eeb8cd6e3d4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:29.885438 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-c84fc9dd-8243-4da9-812b-6eeb8cd6e3d4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1095 microversion: 2.1 time: 0.080173 Dec 17 13:24:29.886280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1536/3073] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:29 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:30.908980 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-1902a39c-d79d-4d55-ab23-71b5743a99d2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:30.910071 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-1902a39c-d79d-4d55-ab23-71b5743a99d2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:30.967431 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-1902a39c-d79d-4d55-ab23-71b5743a99d2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:30.974945 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-1902a39c-d79d-4d55-ab23-71b5743a99d2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1095 microversion: 2.1 time: 0.070166 Dec 17 13:24:30.975749 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1538/3074] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:30 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:31.994935 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:31.995583 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:32.002667 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:32.003117 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:32.003912 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:32.004344 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:32.069871 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:32.081571 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-96dc0477-0abc-4cf8-963c-2a92e65b44b7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1145 microversion: 2.1 time: 0.092753 Dec 17 13:24:32.082143 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1537/3075] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:31 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:33.098658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:33.099268 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:33.106640 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:33.107162 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:33.108107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:33.108547 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:33.183053 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:33.191911 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-94958da9-0e27-4699-89a5-570f3a61904e tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1211 microversion: 2.1 time: 0.097015 Dec 17 13:24:33.192693 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1539/3076] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:33 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:34.143788 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-cdc89c66-ec57-4090-be44-9ca077b566dc req-987c11a7-c523-4e3f-8ab4-2fa2db113e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7272eada-2c5f-4af6-b419-f5070dc336c2", "tag": "29551d75-1e21-41e9-9c65-08f5541a697b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:24:34.145360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:24:34.145360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:24:34.158043 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-cdc89c66-ec57-4090-be44-9ca077b566dc req-987c11a7-c523-4e3f-8ab4-2fa2db113e20 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:34.158481 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-cdc89c66-ec57-4090-be44-9ca077b566dc req-987c11a7-c523-4e3f-8ab4-2fa2db113e20 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:34.169869 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-cdc89c66-ec57-4090-be44-9ca077b566dc req-987c11a7-c523-4e3f-8ab4-2fa2db113e20 service nova] Creating event network-changed:29551d75-1e21-41e9-9c65-08f5541a697b for instance 7272eada-2c5f-4af6-b419-f5070dc336c2 on hv-cinder-80152 Dec 17 13:24:34.176781 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-cdc89c66-ec57-4090-be44-9ca077b566dc req-987c11a7-c523-4e3f-8ab4-2fa2db113e20 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104306 Dec 17 13:24:34.177458 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1538/3077] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:24:34.216086 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:34.216929 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:34.224205 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:34.224939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:34.226046 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:34.226736 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:34.370025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:34.378237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-6cac86a6-18b6-4aad-83d1-69b34d9e8b59 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.165904 Dec 17 13:24:34.378936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1540/3078] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:34 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:35.399014 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:35.399773 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:35.408202 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:35.408763 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:35.409779 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:35.410316 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:35.551909 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:35.562541 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-df70a595-07d6-41b2-80c3-88d01f7742c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.169388 Dec 17 13:24:35.563120 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1539/3079] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:35 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:36.579839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:36.580439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:36.587197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:36.587646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:36.588422 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:36.588867 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:36.729916 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:36.738129 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-18cb791c-2ede-4e63-a6bc-2cd16ddc553d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.162239 Dec 17 13:24:36.738701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1541/3080] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:36 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:37.759040 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:37.760015 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:37.768098 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:37.768548 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:37.769333 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:37.769800 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:37.901454 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:37.909522 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-90ebdd60-7b15-46a8-af5b-0d4a6a5bb2be tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.156663 Dec 17 13:24:37.910097 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1540/3081] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:37 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:38.930420 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:38.931564 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:38.942359 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:38.943090 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:38.944363 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:38.945074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:39.083237 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:39.094286 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-77c9fa1f-6bef-4d3b-95f7-d0251566c9c9 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.170275 Dec 17 13:24:39.095106 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1542/3082] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:38 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:40.119977 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:40.120854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:40.128412 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:40.128863 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:40.129653 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:40.130096 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:40.266350 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:40.273815 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-cc78681c-6db5-4420-8750-4068654d006d tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.160168 Dec 17 13:24:40.274465 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1541/3083] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:40 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:41.294658 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:41.295327 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:41.303305 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:41.303839 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:41.304733 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:41.305244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:41.448773 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:41.456412 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f5384f3b-2c91-4703-b5b5-4f99a95e9b02 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.168159 Dec 17 13:24:41.457147 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1543/3084] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:41 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:42.474888 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:42.475602 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:42.484315 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:42.484877 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:42.485886 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:42.486428 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:42.630314 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:42.637970 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-1df36fa2-28f6-4ac8-92b7-6c17dbbb9c39 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.167676 Dec 17 13:24:42.638528 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1542/3085] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:42 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:43.658160 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:43.659139 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:43.669989 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:43.670433 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:43.671198 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:43.671622 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:43.819453 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:43.828701 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-9631c21d-0cff-47be-b3c0-ee8d6a040bd8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.176446 Dec 17 13:24:43.829515 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1544/3086] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:43 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:44.850379 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:44.851044 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:44.857734 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:44.858177 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:44.858951 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:44.859376 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:44.991372 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:45.002908 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-71331e33-2a5a-4503-98ed-47744bab35bc tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.155921 Dec 17 13:24:45.003865 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1543/3087] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:44 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:46.023035 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:46.023632 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:46.032245 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:46.032718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:46.033505 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:46.033936 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:46.174174 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:46.181512 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-f1e0fd10-752a-4569-b9ff-214947e6cad2 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.164463 Dec 17 13:24:46.182133 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1545/3088] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:46 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:46.456221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-a290f989-a4b6-4c31-8208-39330599d0d6 req-a64b3be4-dc19-40fd-a9c4-0c53dfab6e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7272eada-2c5f-4af6-b419-f5070dc336c2", "name": "network-vif-plugged", "status": "completed", "tag": "29551d75-1e21-41e9-9c65-08f5541a697b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:24:46.457761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:24:46.457761 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:24:46.464592 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a290f989-a4b6-4c31-8208-39330599d0d6 req-a64b3be4-dc19-40fd-a9c4-0c53dfab6e59 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:46.465018 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-a290f989-a4b6-4c31-8208-39330599d0d6 req-a64b3be4-dc19-40fd-a9c4-0c53dfab6e59 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:46.475998 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-a290f989-a4b6-4c31-8208-39330599d0d6 req-a64b3be4-dc19-40fd-a9c4-0c53dfab6e59 service nova] Creating event network-vif-plugged:29551d75-1e21-41e9-9c65-08f5541a697b for instance 7272eada-2c5f-4af6-b419-f5070dc336c2 on hv-cinder-80152 Dec 17 13:24:46.481193 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-a290f989-a4b6-4c31-8208-39330599d0d6 req-a64b3be4-dc19-40fd-a9c4-0c53dfab6e59 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084033 Dec 17 13:24:46.481798 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1544/3089] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:24:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:24:47.201922 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:47.202871 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:47.209482 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:47.211182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:47.211182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:47.211182 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:47.359042 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:47.367477 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-96510989-2c84-4d12-837e-25c38d8fa01c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1267 microversion: 2.1 time: 0.171667 Dec 17 13:24:47.368025 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1546/3090] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:47 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:48.387362 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:48.388317 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:48.396944 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:48.397587 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:48.398617 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:48.399231 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:48.550037 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:48.558545 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-7b3d5dcf-1c5f-4b23-9006-0fbcedc07592 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1454 microversion: 2.1 time: 0.177293 Dec 17 13:24:48.559155 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1545/3091] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:48 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:48.574374 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:24:48.574978 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:24:48.581927 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:48.582312 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:48.583077 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:48.583508 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:48.734069 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:24:48.742105 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-160ad371-82e9-4c9c-b628-8bafd9e99f89 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1454 microversion: 2.1 time: 0.171403 Dec 17 13:24:48.742716 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1547/3092] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:24:48 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:24:50.454506 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-0d6fa110-8543-4305-baea-0142d96f9d94 req-f4679833-230f-450c-bf50-ec4dc0e72db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7272eada-2c5f-4af6-b419-f5070dc336c2", "tag": "29551d75-1e21-41e9-9c65-08f5541a697b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:24:50.456609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:24:50.456609 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:24:50.466656 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-0d6fa110-8543-4305-baea-0142d96f9d94 req-f4679833-230f-450c-bf50-ec4dc0e72db1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:24:50.467310 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-0d6fa110-8543-4305-baea-0142d96f9d94 req-f4679833-230f-450c-bf50-ec4dc0e72db1 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:24:50.479669 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-0d6fa110-8543-4305-baea-0142d96f9d94 req-f4679833-230f-450c-bf50-ec4dc0e72db1 service nova] Creating event network-changed:29551d75-1e21-41e9-9c65-08f5541a697b for instance 7272eada-2c5f-4af6-b419-f5070dc336c2 on hv-cinder-80152 Dec 17 13:24:50.484838 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-0d6fa110-8543-4305-baea-0142d96f9d94 req-f4679833-230f-450c-bf50-ec4dc0e72db1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036394 Dec 17 13:24:50.485805 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1546/3093] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:24:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:25:04.348364 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:25:04.348931 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:25:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:25:09.493484 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:25:09.494280 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:25:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:25:10.707790 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:25:10.708367 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:25:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:25:18.926804 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:25:18.927365 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:25:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:26:40.361428 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:40.362072 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:40.362163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 17 13:26:40.366229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-6a4e6348-017d-4e4d-8815-eb30672f6a23 req-8316b66b-d2a8-45e5-ac40-2804da60d7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7272eada-2c5f-4af6-b419-f5070dc336c2", "tag": "29551d75-1e21-41e9-9c65-08f5541a697b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:26:40.367907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:26:40.367907 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:26:40.368271 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:40.368718 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:40.369525 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:40.369955 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:40.376358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-6a4e6348-017d-4e4d-8815-eb30672f6a23 req-8316b66b-d2a8-45e5-ac40-2804da60d7e8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:40.376941 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-6a4e6348-017d-4e4d-8815-eb30672f6a23 req-8316b66b-d2a8-45e5-ac40-2804da60d7e8 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:40.395549 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-6a4e6348-017d-4e4d-8815-eb30672f6a23 req-8316b66b-d2a8-45e5-ac40-2804da60d7e8 service nova] Creating event network-changed:29551d75-1e21-41e9-9c65-08f5541a697b for instance 7272eada-2c5f-4af6-b419-f5070dc336c2 on hv-cinder-80152 Dec 17 13:26:40.404833 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:26:40.404984 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-6a4e6348-017d-4e4d-8815-eb30672f6a23 req-8316b66b-d2a8-45e5-ac40-2804da60d7e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046459 Dec 17 13:26:40.405836 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1547/3094] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:26:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:26:40.499092 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-19a36388-cd3d-4f79-ac2f-b4605ac659a4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 204 len: 0 microversion: 2.1 time: 0.142745 Dec 17 13:26:40.499939 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1548/3095] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:26:40 2021] DELETE /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:26:40.510076 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:40.511050 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:40.517661 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:40.518138 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:40.518919 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:40.519358 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:40.738682 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:40.747476 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-65790e11-30e0-499a-93dd-caadbcf00ff6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1578 microversion: 2.1 time: 0.241266 Dec 17 13:26:40.747711 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1548/3096] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:40 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:41.766265 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:41.766898 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:41.775353 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:41.775827 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:41.776628 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:41.777075 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:41.921970 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:41.929865 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-16fec773-1761-4823-bcbd-1908a3fa0f54 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1460 microversion: 2.1 time: 0.168133 Dec 17 13:26:41.930463 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1549/3097] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:41 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1460 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:42.662408 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-2d2f303a-b76d-489a-973c-a0b5c911f1bd req-ab6cc493-4c9d-4e04-b520-0eee299d082b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7272eada-2c5f-4af6-b419-f5070dc336c2", "name": "network-vif-deleted", "tag": "29551d75-1e21-41e9-9c65-08f5541a697b"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:26:42.663995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:26:42.663995 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:26:42.687915 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-2d2f303a-b76d-489a-973c-a0b5c911f1bd req-ab6cc493-4c9d-4e04-b520-0eee299d082b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:42.688353 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-2d2f303a-b76d-489a-973c-a0b5c911f1bd req-ab6cc493-4c9d-4e04-b520-0eee299d082b service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:42.698939 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad44941c-6487-4786-9ff9-72ae36bad667] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45580. Dec 17 13:26:42.701229 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-2d2f303a-b76d-489a-973c-a0b5c911f1bd req-ab6cc493-4c9d-4e04-b520-0eee299d082b service nova] Creating event network-vif-deleted:29551d75-1e21-41e9-9c65-08f5541a697b for instance 7272eada-2c5f-4af6-b419-f5070dc336c2 on hv-cinder-80152 Dec 17 13:26:42.706278 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-2d2f303a-b76d-489a-973c-a0b5c911f1bd req-ab6cc493-4c9d-4e04-b520-0eee299d082b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047365 Dec 17 13:26:42.707071 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1549/3098] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:26:42.947232 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:42.947964 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:42.955987 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:42.956409 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:42.957446 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:42.957868 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:43.023341 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:43.031770 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-20148366-4aaa-4363-ba64-cff11ff11252 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 200 len: 1226 microversion: 2.1 time: 0.088657 Dec 17 13:26:43.042567 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1550/3099] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:42 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:44.054898 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:44.056061 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 7272eada-2c5f-4af6-b419-f5070dc336c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:44.066678 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:44.067419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:44.068673 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:44.069419 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:44.084013 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] HTTP exception thrown: Instance 7272eada-2c5f-4af6-b419-f5070dc336c2 could not be found. Dec 17 13:26:44.084556 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Returning 404 to user: Instance 7272eada-2c5f-4af6-b419-f5070dc336c2 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:26:44.085391 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-832b3581-0c38-4d6d-a7b6-c0fca02548a6 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2" status: 404 len: 111 microversion: 2.1 time: 0.038267 Dec 17 13:26:44.085902 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1550/3100] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:44 2021] GET /compute/v2.1/servers/7272eada-2c5f-4af6-b419-f5070dc336c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:26:47.255841 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:47.256379 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:47.268961 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:47.269456 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:47.270244 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:47.270825 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:47.297761 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Going to try to terminate instance {{(pid=127716) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 17 13:26:47.319221 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-40d4e241-bbab-408c-ae32-a57ff1ee30a8 req-fe3e4093-a50c-4c6d-bc12-c6d45157a4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac3a216-462a-4b1e-8ba4-39679fb5f2c2", "tag": "2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:26:47.320820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:26:47.320820 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:26:47.328693 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-40d4e241-bbab-408c-ae32-a57ff1ee30a8 req-fe3e4093-a50c-4c6d-bc12-c6d45157a4c0 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:47.329142 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-40d4e241-bbab-408c-ae32-a57ff1ee30a8 req-fe3e4093-a50c-4c6d-bc12-c6d45157a4c0 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:47.341321 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-40d4e241-bbab-408c-ae32-a57ff1ee30a8 req-fe3e4093-a50c-4c6d-bc12-c6d45157a4c0 service nova] Creating event network-changed:2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c for instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 on hv-cinder-80152 Dec 17 13:26:47.346812 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-40d4e241-bbab-408c-ae32-a57ff1ee30a8 req-fe3e4093-a50c-4c6d-bc12-c6d45157a4c0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086169 Dec 17 13:26:47.347802 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1551/3101] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:26:47.380016 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-70d440ae-87cd-4b09-a8ba-3c04e80197e7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 204 len: 0 microversion: 2.1 time: 0.127671 Dec 17 13:26:47.384124 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1551/3102] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:26:47 2021] DELETE /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 17 13:26:47.390132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:47.390852 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:47.397255 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:47.397741 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:47.398521 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:47.398956 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:47.628091 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.policy [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127717) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:47.636854 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-6171b2ca-8b86-40fa-bb1b-2081020759a7 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1576 microversion: 2.1 time: 0.250925 Dec 17 13:26:47.637473 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1552/3103] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:47 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:48.656526 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:48.657413 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:48.665636 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:48.666107 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:48.666890 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:48.667320 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:48.801649 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:48.809819 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-67a32756-f1a5-47ea-a38c-98fc1e4b576a tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1458 microversion: 2.1 time: 0.158468 Dec 17 13:26:48.810392 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1552/3104] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:48 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:49.717052 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [req-9044a6c0-2ba2-430a-811d-b47a37928805 req-f624fb8e-1257-4e2b-9785-c7d3941673b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac3a216-462a-4b1e-8ba4-39679fb5f2c2", "name": "network-vif-deleted", "tag": "2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c"}]} {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 17 13:26:49.718905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 17 13:26:49.718905 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: warnings.warn(msg) Dec 17 13:26:49.727035 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-9044a6c0-2ba2-430a-811d-b47a37928805 req-f624fb8e-1257-4e2b-9785-c7d3941673b2 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:49.727486 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [req-9044a6c0-2ba2-430a-811d-b47a37928805 req-f624fb8e-1257-4e2b-9785-c7d3941673b2 service nova] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:49.739360 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.compute.server_external_events [req-9044a6c0-2ba2-430a-811d-b47a37928805 req-f624fb8e-1257-4e2b-9785-c7d3941673b2 service nova] Creating event network-vif-deleted:2b47d0bb-cbb3-4fd4-add1-ef3ea486d82c for instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 on hv-cinder-80152 Dec 17 13:26:49.744519 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [req-9044a6c0-2ba2-430a-811d-b47a37928805 req-f624fb8e-1257-4e2b-9785-c7d3941673b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031041 Dec 17 13:26:49.745125 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1553/3105] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Dec 17 13:26:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 17 13:26:49.826468 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:49.827074 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:49.833789 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:49.834235 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:49.835013 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:49.835439 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:49.895717 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.policy [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb0f6186c4145ed858e7e44b0ceda3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ea7b474f1b4c24b7afd417f1f08df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127716) authorize /opt/stack/nova/nova/policy.py:199}} Dec 17 13:26:49.903879 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-58605c63-ef9b-4f5e-917c-907e6f031af8 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 200 len: 1225 microversion: 2.1 time: 0.081128 Dec 17 13:26:49.904556 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1553/3106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:49 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 17 13:26:50.926038 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:50.927194 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:50.937690 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:50.938447 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:50.939727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:50.940503 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:50.955841 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] HTTP exception thrown: Instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 could not be found. Dec 17 13:26:50.956426 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Returning 404 to user: Instance 8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:26:50.957302 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-2524489d-2118-4dd8-819d-b258daf42fc4 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2" status: 404 len: 111 microversion: 2.1 time: 0.038651 Dec 17 13:26:50.957810 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1554/3107] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:50 2021] GET /compute/v2.1/servers/8ac3a216-462a-4b1e-8ba4-39679fb5f2c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:26:51.703511 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:51.704082 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.compute.api [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127716) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:51.710958 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:51.711402 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:51.712191 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:51.712621 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG oslo_concurrency.lockutils [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:51.726062 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.wsgi [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] HTTP exception thrown: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. Dec 17 13:26:51.726659 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Returning 404 to user: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. {{(pid=127716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:26:51.727613 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-18ddc50b-bd49-445c-bae8-03d084f1ae0c tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 404 len: 111 microversion: 2.1 time: 0.028047 Dec 17 13:26:51.728141 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1554/3108] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Dec 17 13:26:51 2021] DELETE /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:26:51.736567 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '>' {{(pid=127717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:51.737163 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.compute.api [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] [instance: 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f] Fetching instance by UUID {{(pid=127717) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 17 13:26:51.743858 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:51.744453 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:51.745531 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 17 13:26:51.746132 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG oslo_concurrency.lockutils [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Lock "70d6da78-ff38-4fe6-9546-7442c31f6ddc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 17 13:26:51.762355 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.wsgi [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] HTTP exception thrown: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. Dec 17 13:26:51.762949 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: DEBUG nova.api.openstack.wsgi [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Returning 404 to user: Instance 3c869dc7-c330-4757-9e2f-c2ccbeb58b2f could not be found. {{(pid=127717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 17 13:26:51.763751 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO nova.api.openstack.requestlog [None req-8df399d8-7ece-48a5-b486-5bf7b4ed6393 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f" status: 404 len: 111 microversion: 2.1 time: 0.031255 Dec 17 13:26:51.764282 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: [pid: 127717|app: 0|req: 1555/3109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Dec 17 13:26:51 2021] GET /compute/v2.1/servers/3c869dc7-c330-4757-9e2f-c2ccbeb58b2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 17 13:26:53.068151 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: DEBUG nova.api.openstack.wsgi [None req-0ed171b8-b79d-4cba-bd0d-6eb5f3eba800 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] Calling method '.version_select at 0x7fba11481430>' {{(pid=127716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 17 13:26:53.095056 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO nova.api.openstack.requestlog [None req-0ed171b8-b79d-4cba-bd0d-6eb5f3eba800 tempest-TestVolumeBootPattern-405676735 tempest-TestVolumeBootPattern-405676735-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1250858390" status: 202 len: 0 microversion: 2.1 time: 0.031301 Dec 17 13:26:53.095885 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: [pid: 127716|app: 0|req: 1555/3110] 10.222.0.45 () {58 vars in 1262 bytes} [Fri Dec 17 13:26:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1250858390 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 17 13:28:24.367111 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:28:24.367813 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:28:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:28:29.512149 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:28:29.512876 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:28:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:30:06.015934 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:30:06.016598 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:30:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:30:10.732646 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:30:10.733375 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:30:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:31:44.385739 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:31:44.386461 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:31:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:31:49.536933 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:31:49.537727 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:31:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:31:58.948635 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:31:58.949197 dv-cinder-801522-9-iscsi devstack@n-api.service[127716]: Fri Dec 17 13:31:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 17 13:32:12.947616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 17 13:32:12.947616 dv-cinder-801522-9-iscsi devstack@n-api.service[127717]: Fri Dec 17 13:32:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!